Jul 23 10:14:00 devstack cinder-volume[77323]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 10:14:00 devstack cinder-volume[77323]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 10:14:00 devstack cinder-volume[77323]: we strongly recommend against using it for new projects. Jul 23 10:14:00 devstack cinder-volume[77323]: If you are already using Eventlet, we recommend migrating to a different Jul 23 10:14:00 devstack cinder-volume[77323]: framework. For more detail see Jul 23 10:14:00 devstack cinder-volume[77323]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 10:14:00 devstack cinder-volume[77323]: import eventlet # noqa Jul 23 10:14:02 devstack cinder-volume[77323]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 10:14:02 devstack cinder-volume[77323]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 10:14:02 devstack cinder-volume[77323]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 10:14:03 devstack cinder-volume[77323]: INFO dbcounter [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Registered counter for database cinder Jul 23 10:14:03 devstack cinder-volume[77323]: DEBUG oslo_db.sqlalchemy.engines [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:14:04 devstack cinder-volume[77323]: DEBUG dbcounter [-] [77323] Writer thread running {{(pid=77323) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 10:14:04 devstack cinder-volume[77323]: INFO cinder.rpc [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 10:14:04 devstack cinder-volume[77323]: INFO cinder.rpc [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 10:14:04 devstack cinder-volume[77323]: DEBUG oslo_db.sqlalchemy.engines [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:14:04 devstack cinder-volume[77323]: INFO cinder.volume.manager [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Determined volume DB was empty at startup. Jul 23 10:14:04 devstack cinder-volume[77323]: DEBUG cinder.volume.manager [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77323) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 10:14:04 devstack cinder-volume[77323]: INFO cinder.volume.manager [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 23 10:14:04 devstack cinder-volume[77323]: WARNING stevedore.named [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 10:14:04 devstack cinder-volume[77323]: WARNING castellan.key_manager [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 10:14:04 devstack cinder-volume[77323]: WARNING cinder.keymgr.conf_key_mgr [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 10:14:04 devstack cinder-volume[77323]: DEBUG cinder.volume.drivers.lvm [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77323) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 23 10:14:04 devstack cinder-volume[77323]: DEBUG oslo_concurrency.processutils [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77323) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:04 devstack cinder-volume[77323]: DEBUG oslo_concurrency.processutils [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] CMD "cinder-rtstool verify" returned: 0 in 0.445s {{(pid=77323) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_db.sqlalchemy.engines [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:14:05 devstack cinder-volume[77323]: INFO cinder.rpc [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 23 10:14:05 devstack cinder-volume[77323]: INFO cinder.rpc [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 23 10:14:05 devstack cinder-volume[77323]: WARNING stevedore.named [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 10:14:05 devstack cinder-volume[77323]: WARNING castellan.key_manager [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 10:14:05 devstack cinder-volume[77323]: INFO cinder.volume.manager [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_db.sqlalchemy.engines [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:14:05 devstack cinder-volume[77323]: INFO oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Starting 1 workers Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Started child 77507 {{(pid=77323) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Full set of CONF: {{(pid=77323) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] ******************************************************************************** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Configuration options gathered from: {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] ================================================================================ {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] allow_availability_zone_fallback = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77507]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] allow_compression_on_image_upload = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] allowed_direct_url_schemes = [] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] api_rate_limit = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] auth_strategy = keystone {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] az_cache_duration = 3600 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_availability_zone = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_host = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_name = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_stats_polling_interval = 60 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backup_api_class = cinder.backup.api.API {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backup_name_template = backup-%s {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backup_use_same_host = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backup_use_temp_snapshot = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] chap_password = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] chap_username = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cinder_internal_tenant_project_id = e700b7dad06f4b74aa134209bccbfcb1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cinder_internal_tenant_user_id = 178cb99eeb274915bceec95949981625 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cloned_volume_same_az = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cluster = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] compression_format = gzip {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] compute_api_class = cinder.compute.nova.API {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] config_dir = [] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] config_source = [] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] control_exchange = openstack {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] debug = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] default_availability_zone = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] default_group_type = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] default_volume_type = lvmdriver-1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] disk_geometry = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] driver_client_cert = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] driver_client_cert_key = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] driver_data_namespace = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] driver_ssl_cert_path = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] driver_ssl_cert_verify = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] driver_use_ssl = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] enable_force_upload = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] enable_new_services = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] enable_unsupported_driver = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] enforce_multipath_for_image_xfer = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] filter_function = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance_api_insecure = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance_api_servers = ['http://192.168.122.141/image'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance_api_ssl_compression = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance_ca_certificates_file = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance_catalog_info = image:glance:publicURL {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance_certfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance_keyfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance_num_retries = 3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance_request_timeout = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] goodness_function = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] graceful_shutdown_timeout = 5 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] group_api_class = cinder.group.api.API {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] host = devstack {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] image_compress_on_upload = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] image_conversion_address_space_limit = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] image_conversion_cpu_limit = 60 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] image_conversion_disable = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] image_upload_use_cinder_backend = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] image_upload_use_internal_tenant = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] image_volume_cache_enabled = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] image_volume_cache_max_count = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] image_volume_cache_max_size_gb = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] init_host_max_objects_retrieval = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] instance_format = [instance: %(uuid)s] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] iscsi_target_flags = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] iscsi_write_cache = on {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] iser_helper = tgtadm {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] iser_ip_address = 192.168.122.141 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] iser_port = 3260 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] log_color = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] log_config_append = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] log_dir = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] log_file = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] log_options = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] log_rotate_interval = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] log_rotate_interval_type = days {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] log_rotation_type = none {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] max_age = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] max_logfile_count = 30 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] max_logfile_size_mb = 200 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] max_over_subscription_ratio = 20.0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] message_reap_interval = 86400 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] message_ttl = 2592000 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] migration_create_volume_timeout_secs = 300 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] monkey_patch = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] monkey_patch_modules = [] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] my_ip = 192.168.122.141 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] no_snapshot_gb_quota = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] num_iser_scan_tries = 3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] num_shell_tries = 3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] num_volume_device_scan_tries = 3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] nvmeof_conn_info_version = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] nvmet_ns_id = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] nvmet_port_id = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] osapi_max_limit = 1000 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] osapi_volume_ext_list = [] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] osapi_volume_listen_port = 8776 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] osapi_volume_use_ssl = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] osapi_volume_workers = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] per_volume_size_limit = -1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] periodic_fuzzy_delay = 60 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] periodic_interval = 60 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] public_endpoint = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] publish_errors = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] quota_backup_gigabytes = 1000 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] quota_backups = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] quota_gigabytes = 1000 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] quota_groups = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] quota_snapshots = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] quota_volumes = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] rate_limit_burst = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] rate_limit_except_level = CRITICAL {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] rate_limit_interval = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] reinit_driver_count = 3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] replication_device = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] report_discard_supported = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] report_interval = 120 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] reservation_clean_interval = 86400 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] reservation_expire = 86400 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] reserved_image_namespaces = [] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] reserved_percentage = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77507]: INFO cinder.volume.manager [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] rpc_response_timeout = 120 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] run_external_periodic_tasks = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] scst_target_driver = iscsi {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] scst_target_iqn_name = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] service_down_time = 720 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] shell_completion = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] snapshot_name_template = snapshot-%s {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] snapshot_same_host = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] split_loggers = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] state_path = /opt/stack/data/cinder {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] storage_availability_zone = nova {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] storage_protocol = iSCSI {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] syslog_log_facility = LOG_USER {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] target_helper = lioadm {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] target_ip_address = 192.168.122.141 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] target_port = 3260 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] target_protocol = iscsi {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] target_secondary_ip_addresses = [] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] trace_flags = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] transport_url = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] until_refresh = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] use_chap_auth = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] use_default_quota_class = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] use_journal = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] use_json = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] use_multipath_for_image_xfer = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] use_stderr = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] use_syslog = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] verify_glance_signatures = enabled {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_api_class = cinder.volume.api.API {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_backend_name = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_clear = zero {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_clear_ionice = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_clear_size = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_copy_bps_limit = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_dd_blocksize = 1M {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_name_template = volume-%s {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_service_inithost_offload = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volume_usage_audit_period = month {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] zoning_mode = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_concurrency.disable_process_locking = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.auth_section = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.auth_type = password {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.auth_version = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.cache = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.certfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.include_service_catalog = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.insecure = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.interface = public {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.keyfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_password = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcache_username = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.region_name = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.service_type = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.141/identity {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.backend = dogpile.cache.null {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.backend_argument = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.backend_expiration_time = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.config_prefix = cache.oslo {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.debug_cache_backend = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.enable_retry_client = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.enable_socket_keepalive = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.enabled = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.expiration_time = 600 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.hashclient_retry_attempts = 2 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.memcache_dead_retry = 300 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:05 devstack sudo[77514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.memcache_pool_maxsize = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.memcache_sasl_enabled = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack sudo[77514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.password = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.proxies = [] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.redis_db = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.redis_server = localhost:6379 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.retry_attempts = 2 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.retry_delay = 0.0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.socket_keepalive_count = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.socket_keepalive_idle = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.socket_keepalive_interval = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.socket_timeout = 1.0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.tls_allowed_ciphers = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.tls_cafile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.tls_certfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.tls_enabled = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.tls_keyfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cache.username = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] coordination.backend_url = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.asyncio_connection = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.asyncio_slave_connection = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.backend = sqlalchemy {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.connection = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.connection_debug = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.connection_parameters = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.connection_recycle_time = 3600 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.connection_trace = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.db_inc_retry_interval = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.db_max_retries = 20 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.db_max_retry_interval = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.db_retry_interval = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.max_overflow = 50 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.max_pool_size = 5 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.max_retries = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.mysql_wsrep_sync_wait = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.pool_timeout = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.retry_interval = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.slave_connection = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.sqlite_synchronous = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.synchronous_reader = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] database.use_db_reconnect = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler.connection_string = messaging:// {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler.enabled = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler.es_doc_type = notification {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler.es_scroll_size = 10000 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler.es_scroll_time = 2m {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler.filter_error_trace = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler.hmac_keys = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler.sentinel_service_name = mymaster {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler.socket_timeout = 0.1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler.trace_requests = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler.trace_sqlalchemy = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler_jaeger.process_tags = {} {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler_jaeger.service_name_prefix = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] profiler_otlp.service_name_prefix = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_policy.enforce_new_defaults = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_policy.policy_default_rule = default {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_policy.policy_file = policy.yaml {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] privsep_osbrick.group = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] privsep_osbrick.helper_command = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] privsep_osbrick.user = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cinder_sys_admin.group = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cinder_sys_admin.helper_command = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] cinder_sys_admin.user = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] service_user.auth_section = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] service_user.auth_type = password {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] service_user.cafile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] service_user.certfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] service_user.collect_timing = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] service_user.insecure = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] service_user.keyfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] service_user.send_service_user_token = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] service_user.split_loggers = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] service_user.timeout = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance.auth_section = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance.auth_type = password {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance.certfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance.collect_timing = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance.insecure = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance.keyfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance.region_name = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance.split_loggers = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] glance.timeout = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.backend_availability_zone = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.chap_password = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.chap_username = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.disk_geometry = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.driver_client_cert = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.driver_client_cert_key = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.driver_data_namespace = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.driver_use_ssl = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.extra_capabilities = {} {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.filter_function = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.goodness_function = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.iscsi_target_flags = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.iscsi_write_cache = on {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.iser_helper = tgtadm {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.iser_ip_address = 192.168.122.141 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.iser_port = 3260 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.lvm_share_target = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.lvm_type = auto {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.num_shell_tries = 3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.replication_device = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.report_discard_supported = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.reserved_percentage = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.target_helper = tgtadm {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.target_ip_address = 192.168.122.141 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.target_port = 3260 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.target_protocol = iscsi {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.trace_flags = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.unique_fqdn_network = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.use_chap_auth = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.volume_backend_name = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.volume_clear = zero {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.volume_clear_ionice = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.volume_clear_size = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_reports.file_event_handler = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_reports.log_dir = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.backend_host = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.chap_password = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.chap_username = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.disk_geometry = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.driver_client_cert = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.extra_capabilities = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.filter_function = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.goodness_function = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.iser_helper = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.iser_ip_address = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.iser_port = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.lvm_share_target = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.lvm_type = auto {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.num_shell_tries = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.replication_device = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.report_discard_supported = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.reserved_percentage = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.scst_target_driver = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.storage_protocol = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.target_helper = lioadm {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.target_ip_address = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.target_port = 3260 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.trace_flags = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.use_chap_auth = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.volume_clear = zero {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.volume_clear_size = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] lvmdriver-1.volumes_dir = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.ssl = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_notifications.driver = [] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_notifications.retry = -1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] key_manager.fixed_key = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.barbican_api_version = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.barbican_endpoint = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.barbican_endpoint_type = public {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.barbican_region_name = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.cafile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.certfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.collect_timing = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.insecure = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.keyfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.number_of_retries = 60 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.retry_delay = 1 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.send_service_user_token = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.split_loggers = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.timeout = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.verify_ssl = True {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican.verify_ssl_path = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican_service_user.auth_section = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican_service_user.auth_type = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican_service_user.cafile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican_service_user.certfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican_service_user.collect_timing = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican_service_user.insecure = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican_service_user.keyfile = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican_service_user.split_loggers = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] barbican_service_user.timeout = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.approle_role_id = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.approle_secret_id = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.auth_method = approle {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.auth_path = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.kv_mountpoint = secret {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.kv_path = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.kv_version = 2 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.namespace = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.root_token_id = **** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.ssl_ca_crt_file = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.timeout = 60.0 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.token_file = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.token_role = None {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.use_ssl = False {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:14:05 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] ******************************************************************************** {{(pid=77323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 10:14:05 devstack sudo[77514]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:05 devstack sudo[77519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:14:05 devstack sudo[77519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:05 devstack sudo[77519]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.268s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:14:05 devstack cinder-volume[77507]: INFO cinder.brick.local_dev.lvm [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:05 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:05 devstack sudo[77560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 10:14:05 devstack sudo[77560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:06 devstack sudo[77560]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:06 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:06 devstack cinder-volume[77507]: DEBUG cinder.brick.local_dev.lvm [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77507) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 23 10:14:06 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:06 devstack sudo[77681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:14:06 devstack sudo[77681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:06 devstack sudo[77681]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:06 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.499s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:06 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:06 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:06 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:06 devstack sudo[77860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:14:06 devstack sudo[77860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:06 devstack sudo[77860]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:06 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:06 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:06 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:06 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:06 devstack sudo[77950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 23 10:14:06 devstack sudo[77950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:07 devstack sudo[77950]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:07 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:07 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:07 devstack sudo[78034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 10:14:07 devstack sudo[78034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:07 devstack sudo[78034]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:07 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:07 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:07 devstack sudo[78126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 10:14:07 devstack sudo[78126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:07 devstack sudo[78126]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:07 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:07 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:07 devstack sudo[78129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:14:07 devstack sudo[78129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:08 devstack sudo[78129]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:08 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:08 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:08 devstack sudo[78212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:14:08 devstack sudo[78212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:08 devstack sudo[78212]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:08 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:08 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:08 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:08 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:08 devstack sudo[78216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:14:08 devstack sudo[78216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:08 devstack sudo[78216]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:08 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:08 devstack cinder-volume[77507]: INFO cinder.volume.drivers.lvm [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 23 10:14:08 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:08 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:08 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:08 devstack sudo[78303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:14:08 devstack sudo[78303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:09 devstack sudo[78303]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:09 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:09 devstack cinder-volume[77507]: DEBUG cinder.volume.drivers.lvm [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Updating volume stats {{(pid=77507) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 10:14:09 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:09 devstack sudo[78315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 10:14:09 devstack sudo[78315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:09 devstack sudo[78315]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:09 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:09 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:09 devstack sudo[78318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:14:09 devstack sudo[78318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:09 devstack sudo[78318]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:09 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:09 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:09 devstack sudo[78321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:14:09 devstack sudo[78321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:09 devstack sudo[78321]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:09 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:09 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:09 devstack sudo[78324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:14:09 devstack sudo[78324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:10 devstack sudo[78324]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:10 devstack cinder-volume[77507]: INFO cinder.volume.driver [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Driver hasn't implemented _init_vendor_properties() Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG cinder.volume.driver [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77507) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG oslo_db.sqlalchemy.engines [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG dbcounter [-] [77507] Writer thread running {{(pid=77507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG cinder.db.api [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Building query based on filter {{(pid=77507) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG cinder.image.image_utils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77507) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 10:14:10 devstack cinder-volume[77507]: INFO cinder.keymgr.migration [None req-2ad61b05-d4c8-4982-8888-63d481839c73 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG cinder.volume.drivers.lvm [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Updating volume stats {{(pid=77507) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:10 devstack sudo[78327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 10:14:10 devstack sudo[78327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:10 devstack sudo[78327]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:10 devstack sudo[78330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:14:10 devstack sudo[78330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:10 devstack sudo[78330]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:10 devstack sudo[78334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:14:10 devstack sudo[78334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:10 devstack sudo[78334]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:10 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:10 devstack sudo[78339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:14:10 devstack sudo[78339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:11 devstack sudo[78339]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:11 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:11 devstack cinder-volume[77507]: DEBUG cinder.manager [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Notifying Schedulers of capabilities ... {{(pid=77507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:14:11 devstack cinder-volume[77507]: INFO cinder.volume.manager [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Driver initialization completed successfully. Jul 23 10:14:11 devstack cinder-volume[77507]: INFO cinder.manager [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Initiating service 2 cleanup Jul 23 10:14:11 devstack cinder-volume[77507]: INFO cinder.manager [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Service 2 cleanup completed. Jul 23 10:14:11 devstack cinder-volume[77507]: DEBUG cinder.service [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Creating RPC server for service cinder-volume {{(pid=77507) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 10:14:11 devstack cinder-volume[77507]: DEBUG cinder.service [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77507) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 10:14:11 devstack cinder-volume[77507]: INFO cinder.volume.manager [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 23 10:14:11 devstack cinder-volume[77507]: DEBUG cinder.volume.drivers.lvm [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Updating volume stats {{(pid=77507) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 10:14:11 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:11 devstack sudo[78342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 10:14:11 devstack sudo[78342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:11 devstack sudo[78342]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:11 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:11 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:11 devstack sudo[78345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:14:11 devstack sudo[78345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:11 devstack sudo[78345]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:11 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:11 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:11 devstack sudo[78350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:14:11 devstack sudo[78350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:12 devstack sudo[78350]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:12 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:12 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:14:12 devstack sudo[78356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:14:12 devstack sudo[78356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:14:12 devstack sudo[78356]: pam_unix(sudo:session): session closed for user root Jul 23 10:14:12 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:14:12 devstack cinder-volume[77507]: INFO cinder.volume.manager [None req-719e0b81-bdba-42e3-a18a-a2fc796f117c None None] Driver post RPC initialization completed successfully. Jul 23 10:14:15 devstack cinder-volume[77323]: DEBUG dbcounter [-] [77323] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77323) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:14:21 devstack cinder-volume[77507]: DEBUG dbcounter [-] [77507] Writing DB stats cinder:SELECT=4 {{(pid=77507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:14:22 devstack cinder-volume[77507]: DEBUG dbcounter [-] [77507] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:15:00 devstack cinder-volume[77507]: DEBUG oslo_service.periodic_task [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running periodic task VolumeManager._thread_info {{(pid=77507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:15:00 devstack cinder-volume[77507]: DEBUG cinder.volume.manager [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] thread count: 6 {{(pid=77507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:15:00 devstack cinder-volume[77507]: DEBUG cinder.volume.manager [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] thread info: [<_MainThread(MainThread, started 133478546522240)>, , , , , ] {{(pid=77507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:16:00 devstack cinder-volume[77507]: DEBUG oslo_service.periodic_task [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:16:00 devstack cinder-volume[77507]: DEBUG cinder.volume.drivers.lvm [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Updating volume stats {{(pid=77507) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 10:16:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:16:00 devstack sudo[83549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 10:16:00 devstack sudo[83549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:16:00 devstack sudo[83549]: pam_unix(sudo:session): session closed for user root Jul 23 10:16:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:16:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:16:00 devstack sudo[83552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:16:00 devstack sudo[83552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:16:00 devstack sudo[83552]: pam_unix(sudo:session): session closed for user root Jul 23 10:16:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:16:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:16:01 devstack sudo[83555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:16:01 devstack sudo[83555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:16:01 devstack sudo[83555]: pam_unix(sudo:session): session closed for user root Jul 23 10:16:01 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:16:01 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:16:01 devstack sudo[83558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:16:01 devstack sudo[83558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:16:01 devstack sudo[83558]: pam_unix(sudo:session): session closed for user root Jul 23 10:16:01 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:16:01 devstack cinder-volume[77507]: DEBUG cinder.manager [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Notifying Schedulers of capabilities ... {{(pid=77507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:16:01 devstack cinder-volume[77507]: DEBUG oslo_service.periodic_task [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running periodic task VolumeManager._thread_info {{(pid=77507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:16:01 devstack cinder-volume[77507]: DEBUG cinder.volume.manager [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] thread count: 6 {{(pid=77507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:16:01 devstack cinder-volume[77507]: DEBUG cinder.volume.manager [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] thread info: [<_MainThread(MainThread, started 133478546522240)>, , , , , ] {{(pid=77507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:16:22 devstack cinder-volume[77507]: DEBUG dbcounter [-] [77507] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:17:00 devstack cinder-volume[77507]: DEBUG oslo_service.periodic_task [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:17:00 devstack cinder-volume[77507]: DEBUG cinder.volume.drivers.lvm [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Updating volume stats {{(pid=77507) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 10:17:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:17:00 devstack sudo[85370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 10:17:00 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:17:00 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root Jul 23 10:17:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:17:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:17:00 devstack sudo[85373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:17:00 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:17:01 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root Jul 23 10:17:01 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:17:01 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:17:01 devstack sudo[85380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:17:01 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:17:01 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root Jul 23 10:17:01 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:17:01 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:17:01 devstack sudo[85388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:17:01 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:17:01 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root Jul 23 10:17:01 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:17:01 devstack cinder-volume[77507]: DEBUG cinder.manager [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Notifying Schedulers of capabilities ... {{(pid=77507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:17:01 devstack cinder-volume[77507]: DEBUG oslo_service.periodic_task [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running periodic task VolumeManager._thread_info {{(pid=77507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:17:01 devstack cinder-volume[77507]: DEBUG cinder.volume.manager [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] thread count: 6 {{(pid=77507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:17:01 devstack cinder-volume[77507]: DEBUG cinder.volume.manager [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] thread info: [<_MainThread(MainThread, started 133478546522240)>, , , , , ] {{(pid=77507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:18:00 devstack cinder-volume[77507]: DEBUG oslo_service.periodic_task [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:18:00 devstack cinder-volume[77507]: DEBUG cinder.volume.drivers.lvm [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Updating volume stats {{(pid=77507) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 10:18:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:00 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 10:18:00 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:00 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:00 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:18:00 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:00 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:00 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:01 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 10:18:01 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:01 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:01 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:01 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:01 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 10:18:01 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:01 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:01 devstack cinder-volume[77507]: DEBUG oslo_concurrency.processutils [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:01 devstack cinder-volume[77507]: DEBUG cinder.manager [None req-67528699-fa50-4033-b68a-8678dd7c8679 None None] Notifying Schedulers of capabilities ... {{(pid=77507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:18:22 devstack cinder-volume[77507]: DEBUG dbcounter [-] [77507] Writing DB stats cinder:SELECT=1 {{(pid=77507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:18:22 devstack cinder-volume[77507]: DEBUG dbcounter [-] [77507] Writing DB stats cinder:UPDATE=1 {{(pid=77507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:18:36 devstack cinder-volume[77323]: INFO oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Caught SIGTERM, stopping children Jul 23 10:18:36 devstack cinder-volume[77323]: DEBUG oslo_concurrency.lockutils [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Acquiring lock "singleton_lock" {{(pid=77323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 10:18:36 devstack cinder-volume[77323]: DEBUG oslo_concurrency.lockutils [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Acquired lock "singleton_lock" {{(pid=77323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 10:18:36 devstack cinder-volume[77323]: DEBUG oslo_concurrency.lockutils [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Releasing lock "singleton_lock" {{(pid=77323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 10:18:36 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Stop services. {{(pid=77323) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 23 10:18:36 devstack cinder-volume[77323]: DEBUG oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Killing children. {{(pid=77323) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 23 10:18:36 devstack cinder-volume[77323]: INFO oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Waiting on 1 children to exit Jul 23 10:18:36 devstack cinder-volume[77507]: DEBUG oslo_concurrency.lockutils [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Acquiring lock "singleton_lock" {{(pid=77507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 10:18:36 devstack cinder-volume[77507]: DEBUG oslo_concurrency.lockutils [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Acquired lock "singleton_lock" {{(pid=77507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 10:18:36 devstack cinder-volume[77507]: DEBUG oslo_concurrency.lockutils [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Releasing lock "singleton_lock" {{(pid=77507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 10:18:36 devstack cinder-volume[77507]: WARNING amqp [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 10:18:36 devstack cinder-volume[77507]: WARNING amqp [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 10:18:36 devstack cinder-volume[77323]: INFO oslo_service.backend._eventlet.service [None req-0133be6b-bb5a-421f-b6ba-c5e1af778d37 None None] Child 77507 exited with status 0 Jul 23 10:18:36 devstack cinder-volume[87579]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 10:18:36 devstack cinder-volume[87579]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 10:18:36 devstack cinder-volume[87579]: we strongly recommend against using it for new projects. Jul 23 10:18:36 devstack cinder-volume[87579]: If you are already using Eventlet, we recommend migrating to a different Jul 23 10:18:36 devstack cinder-volume[87579]: framework. For more detail see Jul 23 10:18:36 devstack cinder-volume[87579]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 10:18:36 devstack cinder-volume[87579]: import eventlet # noqa Jul 23 10:18:38 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 10:18:38 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 10:18:38 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 10:18:39 devstack cinder-volume[87579]: INFO dbcounter [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Registered counter for database cinder Jul 23 10:18:39 devstack cinder-volume[87579]: DEBUG oslo_db.sqlalchemy.engines [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:18:39 devstack cinder-volume[87579]: DEBUG dbcounter [-] [87579] Writer thread running {{(pid=87579) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 10:18:39 devstack cinder-volume[87579]: INFO cinder.rpc [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 10:18:39 devstack cinder-volume[87579]: INFO cinder.rpc [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 10:18:39 devstack cinder-volume[87579]: DEBUG oslo_db.sqlalchemy.engines [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:18:40 devstack cinder-volume[87579]: INFO cinder.volume.manager [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Determined volume DB was empty at startup. Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG cinder.volume.manager [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87579) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 10:18:40 devstack cinder-volume[87579]: INFO cinder.volume.manager [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 23 10:18:40 devstack cinder-volume[87579]: WARNING stevedore.named [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 10:18:40 devstack cinder-volume[87579]: WARNING castellan.key_manager [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 10:18:40 devstack cinder-volume[87579]: WARNING cinder.keymgr.conf_key_mgr [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 10:18:40 devstack cinder-volume[87579]: INFO cinder.volume.manager [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_db.sqlalchemy.engines [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:18:40 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Starting 1 workers Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Started child 87792 {{(pid=87579) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 10:18:40 devstack cinder-volume[87792]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Full set of CONF: {{(pid=87579) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] ******************************************************************************** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Configuration options gathered from: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] ================================================================================ {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] allow_availability_zone_fallback = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] allow_compression_on_image_upload = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] allowed_direct_url_schemes = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] api_rate_limit = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] auth_strategy = keystone {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_availability_zone = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_host = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_stats_polling_interval = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backup_api_class = cinder.backup.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backup_name_template = backup-%s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backup_use_same_host = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backup_use_temp_snapshot = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] chap_password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] chap_username = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cinder_internal_tenant_project_id = e700b7dad06f4b74aa134209bccbfcb1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cinder_internal_tenant_user_id = 178cb99eeb274915bceec95949981625 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cluster = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] compression_format = gzip {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] compute_api_class = cinder.compute.nova.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] config_dir = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] config_source = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] control_exchange = openstack {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] debug = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] default_availability_zone = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] default_group_type = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] default_volume_type = QuobyteHD {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] disk_geometry = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] driver_client_cert = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] driver_client_cert_key = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] driver_data_namespace = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] driver_ssl_cert_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] driver_ssl_cert_verify = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] driver_use_ssl = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] enable_new_services = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] enable_unsupported_driver = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] enabled_backends = ['QuobyteHD'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] enforce_multipath_for_image_xfer = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] filter_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance_api_insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance_api_servers = ['http://192.168.122.141/image'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance_api_ssl_compression = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance_ca_certificates_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance_catalog_info = image:glance:publicURL {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance_certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance_keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance_num_retries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance_request_timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] goodness_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] graceful_shutdown_timeout = 5 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] group_api_class = cinder.group.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] host = devstack {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] image_compress_on_upload = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] image_conversion_address_space_limit = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] image_conversion_cpu_limit = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] image_conversion_disable = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] image_upload_use_cinder_backend = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] image_upload_use_internal_tenant = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] image_volume_cache_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] image_volume_cache_max_count = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] image_volume_cache_max_size_gb = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] init_host_max_objects_retrieval = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] instance_format = [instance: %(uuid)s] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] iscsi_target_flags = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] iscsi_write_cache = on {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] iser_helper = tgtadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] iser_ip_address = 192.168.122.141 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] iser_port = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] log_color = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] log_config_append = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] log_dir = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] log_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] log_options = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] log_rotate_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87792]: INFO cinder.volume.manager [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Starting volume driver QuobyteDriver (1.2) Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] log_rotate_interval_type = days {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] log_rotation_type = none {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG cinder.volume.drivers.remotefs [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87792) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] max_age = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] max_logfile_count = 30 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] max_logfile_size_mb = 200 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] max_over_subscription_ratio = 20.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] message_reap_interval = 86400 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] message_ttl = 2592000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] migration_create_volume_timeout_secs = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] monkey_patch = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] monkey_patch_modules = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] my_ip = 192.168.122.141 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] no_snapshot_gb_quota = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] num_iser_scan_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] num_shell_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] num_volume_device_scan_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] nvmeof_conn_info_version = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] nvmet_ns_id = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] nvmet_port_id = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] osapi_max_limit = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] osapi_volume_ext_list = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] osapi_volume_listen_port = 8776 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] osapi_volume_use_ssl = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] osapi_volume_workers = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] per_volume_size_limit = -1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] periodic_fuzzy_delay = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] periodic_interval = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] public_endpoint = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] publish_errors = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] quota_backup_gigabytes = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] quota_backups = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] quota_gigabytes = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] quota_groups = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] quota_snapshots = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] quota_volumes = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] rate_limit_burst = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] rate_limit_except_level = CRITICAL {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] rate_limit_interval = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] reinit_driver_count = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] replication_device = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] report_discard_supported = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] report_interval = 120 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] reservation_clean_interval = 86400 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] reservation_expire = 86400 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] reserved_image_namespaces = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] reserved_percentage = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] rpc_response_timeout = 120 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] run_external_periodic_tasks = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] scst_target_driver = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] scst_target_iqn_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] service_down_time = 720 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] shell_completion = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] snapshot_name_template = snapshot-%s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] split_loggers = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] state_path = /opt/stack/data/cinder {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] storage_availability_zone = nova {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] storage_protocol = iSCSI {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] syslog_log_facility = LOG_USER {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] target_helper = lioadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] target_ip_address = 192.168.122.141 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] target_port = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] target_protocol = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] target_secondary_ip_addresses = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] trace_flags = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] transport_url = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] until_refresh = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] use_chap_auth = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] use_default_quota_class = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] use_journal = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] use_json = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] use_multipath_for_image_xfer = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] use_stderr = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG cinder.volume.drivers.quobyte [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87792) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] use_syslog = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] verify_glance_signatures = enabled {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87792]: WARNING cinder.volume.drivers.quobyte [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_api_class = cinder.volume.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_backend_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_clear = zero {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_clear_ionice = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87792]: WARNING cinder.volume.drivers.quobyte [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Running cmd (subprocess): mount.quobyte {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_clear_size = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_copy_bps_limit = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_dd_blocksize = 1M {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_name_template = volume-%s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_service_inithost_offload = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volume_usage_audit_period = month {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] zoning_mode = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_concurrency.disable_process_locking = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.auth_section = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.auth_type = password {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.auth_version = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.cache = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.include_service_catalog = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.interface = public {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_password = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcache_username = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.region_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.service_type = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.141/identity {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.backend = dogpile.cache.null {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.backend_argument = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.backend_expiration_time = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.config_prefix = cache.oslo {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.debug_cache_backend = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.enable_retry_client = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.enable_socket_keepalive = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.expiration_time = 600 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.hashclient_retry_attempts = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.memcache_dead_retry = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.memcache_pool_maxsize = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.memcache_sasl_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.proxies = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.redis_db = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.redis_server = localhost:6379 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.retry_attempts = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.retry_delay = 0.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.socket_keepalive_count = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.socket_keepalive_idle = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.socket_keepalive_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.socket_timeout = 1.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.tls_allowed_ciphers = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.tls_cafile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.tls_certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.tls_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.tls_keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cache.username = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] coordination.backend_url = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.asyncio_connection = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.asyncio_slave_connection = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.backend = sqlalchemy {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.connection = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.connection_debug = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.connection_parameters = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.connection_recycle_time = 3600 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.connection_trace = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.db_inc_retry_interval = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.db_max_retries = 20 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.db_max_retry_interval = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.db_retry_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.max_overflow = 50 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.max_pool_size = 5 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.max_retries = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.mysql_wsrep_sync_wait = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.pool_timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.retry_interval = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.slave_connection = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.sqlite_synchronous = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.synchronous_reader = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] database.use_db_reconnect = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler.connection_string = messaging:// {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler.enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler.es_doc_type = notification {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler.es_scroll_size = 10000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler.es_scroll_time = 2m {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler.filter_error_trace = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler.hmac_keys = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler.sentinel_service_name = mymaster {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler.socket_timeout = 0.1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler.trace_requests = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler.trace_sqlalchemy = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler_jaeger.process_tags = {} {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler_jaeger.service_name_prefix = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] profiler_otlp.service_name_prefix = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_policy.enforce_new_defaults = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_policy.policy_default_rule = default {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_policy.policy_file = policy.yaml {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] privsep_osbrick.group = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] privsep_osbrick.helper_command = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] privsep_osbrick.user = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cinder_sys_admin.group = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cinder_sys_admin.helper_command = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] cinder_sys_admin.user = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] service_user.auth_section = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] service_user.auth_type = password {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] service_user.cafile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] service_user.certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] service_user.collect_timing = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] service_user.insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] service_user.keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] service_user.send_service_user_token = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] service_user.split_loggers = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] service_user.timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance.auth_section = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance.auth_type = password {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance.certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance.collect_timing = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance.insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance.keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance.region_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance.split_loggers = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] glance.timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.backend_availability_zone = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.chap_password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.chap_username = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.disk_geometry = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.driver_client_cert = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.driver_client_cert_key = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.driver_data_namespace = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.driver_use_ssl = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.extra_capabilities = {} {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.filter_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.goodness_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.iscsi_target_flags = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.iscsi_write_cache = on {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.iser_helper = tgtadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.iser_ip_address = 192.168.122.141 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.iser_port = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nas_host = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nas_login = admin {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nas_mount_options = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nas_password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nas_private_key = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nas_share_path = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.num_shell_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.quobyte_volume_url = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.replication_device = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.report_discard_supported = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.reserved_percentage = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] CMD "mount.quobyte" returned: 1 in 0.172s {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.target_helper = tgtadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG cinder.volume.drivers.quobyte [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=87792) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.target_ip_address = 192.168.122.141 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.target_port = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.target_protocol = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.trace_flags = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.unique_fqdn_network = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.use_chap_auth = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.volume_backend_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.volume_clear = zero {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.volume_clear_ionice = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.volume_clear_size = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87792]: INFO cinder.volume.drivers.quobyte [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 ... Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_reports.file_event_handler = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_reports.log_dir = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.backend_availability_zone = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.backend_host = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a -c /etc/quobyte/client-cinder.cfg {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.chap_password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.chap_username = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.chiscsi_conf = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.disk_geometry = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.driver_client_cert = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.driver_data_namespace = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.driver_use_ssl = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.extra_capabilities = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.filter_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.goodness_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.iser_helper = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.iser_ip_address = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.iser_port = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.iser_target_prefix = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nas_host = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nas_login = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nas_mount_options = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nas_password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nas_private_key = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nas_share_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nas_ssh_port = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.num_shell_tries = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.nvmet_port_id = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.replication_device = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.report_discard_supported = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.reserved_percentage = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.scst_target_driver = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.storage_protocol = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.target_helper = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.target_ip_address = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.target_port = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a -c /etc/quobyte/client-cinder.cfg Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.target_prefix = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.target_protocol = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.trace_flags = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.use_chap_auth = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.volume_clear = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.volume_clear_size = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] QuobyteHD.volumes_dir = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.ssl = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_notifications.driver = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_notifications.retry = -1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] key_manager.fixed_key = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.barbican_api_version = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.barbican_endpoint = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.barbican_endpoint_type = public {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.barbican_region_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.cafile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.collect_timing = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.number_of_retries = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.retry_delay = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.send_service_user_token = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.split_loggers = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.verify_ssl = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican.verify_ssl_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican_service_user.auth_section = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican_service_user.auth_type = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican_service_user.cafile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican_service_user.certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican_service_user.collect_timing = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican_service_user.insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican_service_user.keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican_service_user.split_loggers = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] barbican_service_user.timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.approle_role_id = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.approle_secret_id = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.auth_method = approle {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.auth_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.kv_mountpoint = secret {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.kv_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.kv_version = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.namespace = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.root_token_id = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.ssl_ca_crt_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.timeout = 60.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.token_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.token_role = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.use_ssl = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:40 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] ******************************************************************************** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 10:18:40 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.400s {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:40 devstack cinder-volume[87792]: INFO cinder.volume.drivers.quobyte [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 succeeded Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG cinder.volume.drivers.quobyte [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=87792) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.413s {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:18:40 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:40 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:18:40 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:41 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.239s {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:41 devstack cinder-volume[87792]: INFO cinder.volume.driver [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Driver hasn't implemented _init_vendor_properties() Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG cinder.volume.driver [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87792) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_db.sqlalchemy.engines [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG dbcounter [-] [87792] Writer thread running {{(pid=87792) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG cinder.db.api [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Building query based on filter {{(pid=87792) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG cinder.image.image_utils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87792) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 10:18:41 devstack cinder-volume[87792]: INFO cinder.keymgr.migration [None req-ddbbcb5c-a54c-4519-8a7a-86e2a9e35278 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG cinder.volume.drivers.quobyte [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=87792) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG cinder.volume.drivers.quobyte [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=87792) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:41 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:18:41 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:41 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.231s {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG cinder.manager [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Notifying Schedulers of capabilities ... {{(pid=87792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:18:41 devstack cinder-volume[87792]: INFO cinder.volume.manager [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Driver initialization completed successfully. Jul 23 10:18:41 devstack cinder-volume[87792]: INFO cinder.manager [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Initiating service 3 cleanup Jul 23 10:18:41 devstack cinder-volume[87792]: INFO cinder.manager [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Service 3 cleanup completed. Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG cinder.service [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Creating RPC server for service cinder-volume {{(pid=87792) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG cinder.service [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87792) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 10:18:41 devstack cinder-volume[87792]: INFO cinder.volume.manager [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG cinder.volume.drivers.quobyte [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=87792) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG cinder.volume.drivers.quobyte [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=87792) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:41 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:18:41 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:41 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:41 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.276s {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:41 devstack cinder-volume[87792]: INFO cinder.volume.manager [None req-2b5ad089-30bc-43f1-baf4-c68028ae39c3 None None] Driver post RPC initialization completed successfully. Jul 23 10:18:46 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-95000299-410c-45a4-a93a-11c271697bf7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:18:46 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-95000299-410c-45a4-a93a-11c271697bf7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:18:46 devstack cinder-volume[87792]: DEBUG cinder.volume.drivers.quobyte [None req-95000299-410c-45a4-a93a-11c271697bf7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=87792) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:18:46 devstack cinder-volume[87792]: DEBUG cinder.volume.drivers.quobyte [None req-95000299-410c-45a4-a93a-11c271697bf7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=87792) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:18:46 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-95000299-410c-45a4-a93a-11c271697bf7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87792) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:18:46 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-95000299-410c-45a4-a93a-11c271697bf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:46 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:18:46 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:46 devstack cinder-volume[87792]: DEBUG oslo_concurrency.processutils [None req-95000299-410c-45a4-a93a-11c271697bf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.243s {{(pid=87792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:46 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:46 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Caught SIGTERM, stopping children Jul 23 10:18:46 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Acquiring lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 10:18:46 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Acquired lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 10:18:46 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Releasing lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 10:18:46 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Stop services. {{(pid=87579) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 23 10:18:46 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Killing children. {{(pid=87579) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 23 10:18:46 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Waiting on 1 children to exit Jul 23 10:18:46 devstack cinder-volume[87792]: DEBUG cinder.manager [None req-95000299-410c-45a4-a93a-11c271697bf7 None None] Notifying Schedulers of capabilities ... {{(pid=87792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:18:49 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Acquiring lock "singleton_lock" {{(pid=87792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 10:18:49 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Acquired lock "singleton_lock" {{(pid=87792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 10:18:49 devstack cinder-volume[87792]: DEBUG oslo_concurrency.lockutils [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Releasing lock "singleton_lock" {{(pid=87792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 10:18:49 devstack cinder-volume[87792]: WARNING amqp [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 10:18:49 devstack cinder-volume[87792]: WARNING amqp [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 10:18:49 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-399c09d6-66bf-47e3-96f4-6531ad7daaa2 None None] Child 87792 exited with status 0 Jul 23 10:18:50 devstack cinder-volume[88072]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 10:18:50 devstack cinder-volume[88072]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 10:18:50 devstack cinder-volume[88072]: we strongly recommend against using it for new projects. Jul 23 10:18:50 devstack cinder-volume[88072]: If you are already using Eventlet, we recommend migrating to a different Jul 23 10:18:50 devstack cinder-volume[88072]: framework. For more detail see Jul 23 10:18:50 devstack cinder-volume[88072]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 10:18:50 devstack cinder-volume[88072]: import eventlet # noqa Jul 23 10:18:53 devstack cinder-volume[88072]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88072) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 10:18:53 devstack cinder-volume[88072]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88072) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 10:18:53 devstack cinder-volume[88072]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88072) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 10:18:54 devstack cinder-volume[88072]: INFO dbcounter [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Registered counter for database cinder Jul 23 10:18:54 devstack cinder-volume[88072]: DEBUG oslo_db.sqlalchemy.engines [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88072) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:18:54 devstack cinder-volume[88072]: DEBUG dbcounter [-] [88072] Writer thread running {{(pid=88072) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 10:18:54 devstack cinder-volume[88072]: INFO cinder.rpc [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 10:18:54 devstack cinder-volume[88072]: INFO cinder.rpc [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 10:18:54 devstack cinder-volume[88072]: DEBUG oslo_db.sqlalchemy.engines [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88072) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:18:54 devstack cinder-volume[88072]: INFO cinder.volume.manager [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Determined volume DB was empty at startup. Jul 23 10:18:54 devstack cinder-volume[88072]: DEBUG cinder.volume.manager [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88072) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 10:18:54 devstack cinder-volume[88072]: WARNING stevedore.named [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 10:18:54 devstack cinder-volume[88072]: WARNING castellan.key_manager [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 10:18:54 devstack cinder-volume[88072]: WARNING cinder.keymgr.conf_key_mgr [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 10:18:54 devstack cinder-volume[88072]: INFO cinder.volume.manager [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 23 10:18:54 devstack cinder-volume[88072]: DEBUG oslo_db.sqlalchemy.engines [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88072) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:18:55 devstack cinder-volume[88072]: INFO oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Starting 1 workers Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Started child 88371 {{(pid=88072) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Full set of CONF: {{(pid=88072) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] ******************************************************************************** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] Configuration options gathered from: {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] ================================================================================ {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] allow_availability_zone_fallback = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88371]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] allow_compression_on_image_upload = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] allowed_direct_url_schemes = [] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] api_rate_limit = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] auth_strategy = keystone {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_availability_zone = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_host = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_name = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_stats_polling_interval = 60 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backup_api_class = cinder.backup.api.API {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backup_name_template = backup-%s {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backup_use_same_host = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backup_use_temp_snapshot = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] chap_password = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] chap_username = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cinder_internal_tenant_project_id = e700b7dad06f4b74aa134209bccbfcb1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cinder_internal_tenant_user_id = 178cb99eeb274915bceec95949981625 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cluster = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] compression_format = gzip {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] compute_api_class = cinder.compute.nova.API {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] config_dir = [] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] config_source = [] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] control_exchange = openstack {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] debug = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] default_availability_zone = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] default_group_type = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] default_volume_type = QuobyteHD {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] disk_geometry = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] driver_client_cert = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] driver_client_cert_key = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] driver_data_namespace = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] driver_ssl_cert_path = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] driver_ssl_cert_verify = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] driver_use_ssl = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] enable_new_services = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] enable_unsupported_driver = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] enabled_backends = ['QuobyteHD'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] enforce_multipath_for_image_xfer = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] filter_function = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance_api_insecure = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance_api_servers = ['http://192.168.122.141/image'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance_api_ssl_compression = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance_ca_certificates_file = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance_catalog_info = image:glance:publicURL {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance_certfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance_keyfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance_num_retries = 3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance_request_timeout = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] goodness_function = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] graceful_shutdown_timeout = 5 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] group_api_class = cinder.group.api.API {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] host = devstack {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] image_compress_on_upload = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] image_conversion_address_space_limit = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] image_conversion_cpu_limit = 60 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] image_conversion_disable = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] image_upload_use_cinder_backend = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] image_upload_use_internal_tenant = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] image_volume_cache_enabled = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] image_volume_cache_max_count = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] image_volume_cache_max_size_gb = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] init_host_max_objects_retrieval = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] instance_format = [instance: %(uuid)s] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] iscsi_target_flags = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] iscsi_write_cache = on {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] iser_helper = tgtadm {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] iser_ip_address = 192.168.122.141 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] iser_port = 3260 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Starting volume driver QuobyteDriver (1.2) Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] log_color = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] log_config_append = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88371) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] log_dir = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] log_file = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] log_options = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] log_rotate_interval = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] log_rotate_interval_type = days {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] log_rotation_type = none {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] max_age = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] max_logfile_count = 30 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] max_logfile_size_mb = 200 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] max_over_subscription_ratio = 20.0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] message_reap_interval = 86400 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] message_ttl = 2592000 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] migration_create_volume_timeout_secs = 300 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] monkey_patch = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] monkey_patch_modules = [] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] my_ip = 192.168.122.141 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] no_snapshot_gb_quota = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] num_iser_scan_tries = 3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] num_shell_tries = 3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] num_volume_device_scan_tries = 3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] nvmeof_conn_info_version = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] nvmet_ns_id = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] nvmet_port_id = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] osapi_max_limit = 1000 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] osapi_volume_ext_list = [] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] osapi_volume_listen = 0.0.0.0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] osapi_volume_listen_port = 8776 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] osapi_volume_use_ssl = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] osapi_volume_workers = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] per_volume_size_limit = -1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] periodic_fuzzy_delay = 60 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] periodic_interval = 60 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] project_id_regex = [0-9a-f\-]+ {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] public_endpoint = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] publish_errors = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] quota_backup_gigabytes = 1000 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] quota_backups = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] quota_gigabytes = 1000 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] quota_groups = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] quota_snapshots = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] quota_volumes = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] rate_limit_burst = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] rate_limit_except_level = CRITICAL {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] rate_limit_interval = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] reinit_driver_count = 3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] replication_device = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] report_discard_supported = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] report_interval = 120 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] reservation_clean_interval = 86400 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] reservation_expire = 86400 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] reserved_image_namespaces = [] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] reserved_percentage = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] rpc_response_timeout = 120 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] run_external_periodic_tasks = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] scst_target_driver = iscsi {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] scst_target_iqn_name = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] service_down_time = 720 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] shell_completion = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] snapshot_name_template = snapshot-%s {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] split_loggers = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] state_path = /opt/stack/data/cinder {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] storage_availability_zone = nova {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] storage_protocol = iSCSI {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] syslog_log_facility = LOG_USER {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] target_helper = lioadm {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] target_ip_address = 192.168.122.141 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] target_port = 3260 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] target_protocol = iscsi {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] target_secondary_ip_addresses = [] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] trace_flags = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] transfer_api_class = cinder.transfer.api.API {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] transport_url = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] until_refresh = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] use_chap_auth = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] use_default_quota_class = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] use_journal = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] use_json = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] use_multipath_for_image_xfer = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] use_stderr = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] use_syslog = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] verify_glance_signatures = enabled {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_api_class = cinder.volume.api.API {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_backend_name = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_clear = zero {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_clear_ionice = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_clear_size = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_copy_bps_limit = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_dd_blocksize = 1M {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_name_template = volume-%s {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_service_inithost_offload = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volume_usage_audit_period = month {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] zoning_mode = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_concurrency.disable_process_locking = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.auth_section = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.auth_type = password {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.auth_version = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.cache = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.certfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.delay_auth_decision = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.http_connect_timeout = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.include_service_catalog = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.insecure = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.interface = public {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.keyfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_password = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcache_username = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.region_name = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.service_token_roles_required = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.service_type = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.token_cache_time = 300 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88371) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.141/identity {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.quobyte [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.backend = dogpile.cache.null {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.backend_argument = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.backend_expiration_time = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.config_prefix = cache.oslo {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.quobyte [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.debug_cache_backend = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.enable_retry_client = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.enable_socket_keepalive = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.enabled = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Running cmd (subprocess): mount.quobyte {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.expiration_time = 600 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.hashclient_retry_attempts = 2 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.memcache_dead_retry = 300 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.memcache_pool_maxsize = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.memcache_sasl_enabled = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.password = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.proxies = [] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.redis_db = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.redis_sentinel_service_name = mymaster {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.redis_server = localhost:6379 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.retry_attempts = 2 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.retry_delay = 0.0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.socket_keepalive_count = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.socket_keepalive_idle = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.socket_keepalive_interval = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.socket_timeout = 1.0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.tls_allowed_ciphers = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.tls_cafile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.tls_certfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.tls_enabled = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.tls_keyfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cache.username = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] coordination.backend_url = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.asyncio_connection = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.asyncio_slave_connection = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.backend = sqlalchemy {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.connection = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.connection_debug = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.connection_parameters = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.connection_recycle_time = 3600 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.connection_trace = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.db_inc_retry_interval = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.db_max_retries = 20 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.db_max_retry_interval = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.db_retry_interval = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.max_overflow = 50 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.max_pool_size = 5 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.max_retries = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.mysql_wsrep_sync_wait = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.pool_timeout = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.retry_interval = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.slave_connection = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.sqlite_synchronous = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.synchronous_reader = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] database.use_db_reconnect = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler.connection_string = messaging:// {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler.enabled = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler.es_doc_type = notification {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler.es_scroll_size = 10000 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler.es_scroll_time = 2m {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler.filter_error_trace = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler.hmac_keys = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler.sentinel_service_name = mymaster {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler.socket_timeout = 0.1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler.trace_requests = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler.trace_sqlalchemy = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler_jaeger.process_tags = {} {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler_jaeger.service_name_prefix = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] profiler_otlp.service_name_prefix = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_policy.enforce_new_defaults = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_policy.policy_default_rule = default {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_policy.policy_file = policy.yaml {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_policy.remote_timeout = 60.0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] privsep_osbrick.group = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] privsep_osbrick.helper_command = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] privsep_osbrick.user = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cinder_sys_admin.group = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cinder_sys_admin.helper_command = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] cinder_sys_admin.user = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] service_user.auth_section = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] service_user.auth_type = password {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] service_user.cafile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] service_user.certfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] service_user.collect_timing = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] service_user.insecure = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] service_user.keyfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] service_user.send_service_user_token = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] service_user.split_loggers = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] service_user.timeout = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance.auth_section = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance.auth_type = password {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance.certfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance.collect_timing = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance.insecure = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance.keyfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance.region_name = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance.split_loggers = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] glance.timeout = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.backend_availability_zone = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.chap_password = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.chap_username = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.disk_geometry = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack quobyte-client[88372]: Reading configuration file: /etc/quobyte/client.cfg Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.driver_client_cert = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.driver_client_cert_key = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.driver_data_namespace = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack quobyte-client[88372]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.driver_use_ssl = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.enable_unsupported_driver = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.extra_capabilities = {} {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.filter_function = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] CMD "mount.quobyte" returned: 1 in 0.048s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.goodness_function = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.iscsi_target_flags = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.iscsi_write_cache = on {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.iser_helper = tgtadm {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.iser_ip_address = 192.168.122.141 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.iser_port = 3260 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nas_host = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nas_login = admin {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nas_mount_options = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nas_password = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nas_private_key = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nas_share_path = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nas_ssh_port = 22 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.num_shell_tries = 3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.nvmet_port_id = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.quobyte_client_cfg = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.quobyte_volume_url = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.replication_device = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.report_discard_supported = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.reserved_percentage = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.scst_target_driver = iscsi {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.scst_target_iqn_name = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.storage_protocol = iSCSI {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.target_helper = tgtadm {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.target_ip_address = 192.168.122.141 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.target_port = 3260 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.target_protocol = iscsi {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.trace_flags = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.unique_fqdn_network = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.use_chap_auth = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.volume_backend_name = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.volume_clear = zero {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.volume_clear_ionice = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.volume_clear_size = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_reports.file_event_handler = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_reports.log_dir = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.backend_availability_zone = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.backend_host = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.chap_password = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.chap_username = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.chiscsi_conf = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.disk_geometry = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.driver_client_cert = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.driver_client_cert_key = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.driver_data_namespace = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.driver_use_ssl = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.extra_capabilities = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.filter_function = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.goodness_function = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.iscsi_target_flags = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.iscsi_write_cache = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.iser_helper = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.iser_ip_address = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.iser_port = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.iser_target_prefix = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nas_host = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nas_login = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nas_mount_options = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nas_password = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nas_private_key = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nas_share_path = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nas_ssh_port = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.num_shell_tries = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nvmet_ns_id = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.nvmet_port_id = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.replication_device = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.report_discard_supported = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.reserved_percentage = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.scst_target_driver = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.storage_protocol = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.target_helper = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.target_ip_address = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.target_port = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.target_prefix = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.target_protocol = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.trace_flags = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.unique_fqdn_network = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.use_chap_auth = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.volume_clear = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.volume_clear_ionice = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.volume_clear_size = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] QuobyteHD.volumes_dir = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.ssl = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.ssl_version = {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_notifications.driver = [] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_notifications.retry = -1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] oslo_messaging_notifications.transport_url = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] key_manager.fixed_key = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.barbican_api_version = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.barbican_endpoint = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.barbican_endpoint_type = public {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.barbican_region_name = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.cafile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.certfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.collect_timing = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.insecure = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.keyfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.number_of_retries = 60 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.retry_delay = 1 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.send_service_user_token = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.split_loggers = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.timeout = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.verify_ssl = True {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican.verify_ssl_path = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican_service_user.auth_section = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican_service_user.auth_type = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican_service_user.cafile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican_service_user.certfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican_service_user.collect_timing = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican_service_user.insecure = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican_service_user.keyfile = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican_service_user.split_loggers = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] barbican_service_user.timeout = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.approle_role_id = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.approle_secret_id = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.auth_method = approle {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.auth_path = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.kv_mountpoint = secret {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.kv_path = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.kv_version = 2 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.namespace = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.root_token_id = **** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.ssl_ca_crt_file = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.timeout = 60.0 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.token_file = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.token_role = None {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.use_ssl = False {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 10:18:55 devstack cinder-volume[88072]: DEBUG oslo_service.backend._eventlet.service [None req-6de9dad0-8076-4f42-89ab-0e8163796ecc None None] ******************************************************************************** {{(pid=88072) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 10:18:55 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.233s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:55 devstack cinder-volume[88371]: INFO cinder.volume.driver [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Driver hasn't implemented _init_vendor_properties() Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.volume.driver [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88371) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_db.sqlalchemy.engines [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88371) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writer thread running {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.db.api [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Building query based on filter {{(pid=88371) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88371) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:55 devstack cinder-volume[88371]: INFO cinder.keymgr.migration [None req-85e6d8d3-53c8-4750-a1c0-330e9aae2b0a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 10:18:55 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:18:55 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:55 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.234s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:18:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Driver initialization completed successfully. Jul 23 10:18:55 devstack cinder-volume[88371]: INFO cinder.manager [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Initiating service 3 cleanup Jul 23 10:18:55 devstack cinder-volume[88371]: INFO cinder.manager [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Service 3 cleanup completed. Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.service [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Creating RPC server for service cinder-volume {{(pid=88371) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.service [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88371) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 10:18:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:18:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:18:55 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:18:55 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:18:56 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Jul 23 10:18:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.242s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:18:56 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1e1e8bd0-b942-438e-8f0b-353f195fd6fd None None] Driver post RPC initialization completed successfully. Jul 23 10:19:04 devstack cinder-volume[88072]: DEBUG dbcounter [-] [88072] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88072) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:19:05 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:19:06 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=3 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:19:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:19:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 6 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:19:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:19:57 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:19:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Flow 'volume_create_manager' (46264bd7-583a-42fe-9d8e-ab732a48f3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:19:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ebbed4-02d8-433e-8a1b-f583e73cd097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ebbed4-02d8-433e-8a1b-f583e73cd097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1905540187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46017db-6f0b-4081-9678-a292eecc4171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800b0377c1324a959e1b0de4d301eb43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:19:58Z,use_quota=True,user_id='23ed7db5fccc4efb85713462d12ffbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002c8fa2-2483-40bf-8518-fabb41044dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002c8fa2-2483-40bf-8518-fabb41044dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6499b67c-4109-4725-8b66-986f6b76787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6499b67c-4109-4725-8b66-986f6b76787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f46017db-6f0b-4081-9678-a292eecc4171', 'volume_name': 'volume-f46017db-6f0b-4081-9678-a292eecc4171', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280e5e1a-f36b-443e-a8d8-6b4aeff36f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280e5e1a-f36b-443e-a8d8-6b4aeff36f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea5cbec-90cb-44a2-931e-fe4e52d9e9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:19:58 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Volume f46017db-6f0b-4081-9678-a292eecc4171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f46017db-6f0b-4081-9678-a292eecc4171', 'volume_size': 1} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1905540187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46017db-6f0b-4081-9678-a292eecc4171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800b0377c1324a959e1b0de4d301eb43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:19:58Z,use_quota=True,user_id='23ed7db5fccc4efb85713462d12ffbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Creating volume f46017db-6f0b-4081-9678-a292eecc4171 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:19:58 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:19:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:19:58 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171 1073741824 Jul 23 10:19:58 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:19:59 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Jul 23 10:19:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171 1073741824" returned: 0 in 0.931s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:19:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:19:59 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171 Jul 23 10:19:59 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:19:59 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Jul 23 10:19:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171" returned: 0 in 0.374s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:19:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:19:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:19:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea5cbec-90cb-44a2-931e-fe4e52d9e9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46017db-6f0b-4081-9678-a292eecc4171', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:19:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8ef953-5bfd-401c-a3d7-045ae25ec552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:19:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Volume volume-f46017db-6f0b-4081-9678-a292eecc4171 (f46017db-6f0b-4081-9678-a292eecc4171): created successfully Jul 23 10:19:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8ef953-5bfd-401c-a3d7-045ae25ec552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:19:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Flow 'volume_create_manager' (46264bd7-583a-42fe-9d8e-ab732a48f3bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:19:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a2750d6f-517c-4d69-ad8b-42cb2a3d0808 tempest-DeleteServersTestJSON-1880762108 None] Created volume successfully. Jul 23 10:20:04 devstack cinder-volume[88371]: WARNING py.warnings [req-8f435949-f43c-49d3-ad57-bdfa6f5c69db req-bcd30dec-f962-4a9e-b132-b87fd63e8600 tempest-DeleteServersTestJSON-1880762108 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 23 10:20:04 devstack cinder-volume[88371]: .first() Jul 23 10:20:04 devstack cinder-volume[88371]: Jul 23 10:20:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-8f435949-f43c-49d3-ad57-bdfa6f5c69db req-bcd30dec-f962-4a9e-b132-b87fd63e8600 tempest-DeleteServersTestJSON-1880762108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:20:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-8f435949-f43c-49d3-ad57-bdfa6f5c69db req-bcd30dec-f962-4a9e-b132-b87fd63e8600 tempest-DeleteServersTestJSON-1880762108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:20:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-8f435949-f43c-49d3-ad57-bdfa6f5c69db req-bcd30dec-f962-4a9e-b132-b87fd63e8600 tempest-DeleteServersTestJSON-1880762108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:20:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-8f435949-f43c-49d3-ad57-bdfa6f5c69db req-bcd30dec-f962-4a9e-b132-b87fd63e8600 tempest-DeleteServersTestJSON-1880762108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-f46017db-6f0b-4081-9678-a292eecc4171', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da2f7867-4b28-47c0-9a7a-3343afd1911b', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:20:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-8f435949-f43c-49d3-ad57-bdfa6f5c69db req-bcd30dec-f962-4a9e-b132-b87fd63e8600 tempest-DeleteServersTestJSON-1880762108 None] attachment_update completed successfully. Jul 23 10:20:12 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-d2550681-25d2-409d-9de4-c0811b72b605 req-753a211d-2508-4766-becb-aabb577062a5 tempest-DeleteServersTestJSON-1880762108 None] Terminate volume connection completed successfully. Jul 23 10:20:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-d2550681-25d2-409d-9de4-c0811b72b605 req-753a211d-2508-4766-becb-aabb577062a5 tempest-DeleteServersTestJSON-1880762108 None] Deleting attachment da2f7867-4b28-47c0-9a7a-3343afd1911b. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:20:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Acquiring lock "cinder-f46017db-6f0b-4081-9678-a292eecc4171-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:20:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Lock "cinder-f46017db-6f0b-4081-9678-a292eecc4171-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:20:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Acquiring lock "cinder-quobyte-f46017db-6f0b-4081-9678-a292eecc4171" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:20:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Lock "cinder-quobyte-f46017db-6f0b-4081-9678-a292eecc4171" acquired by "delete_volume" :: waited 0.040s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:20:16 devstack cinder-volume[88371]: INFO oslo.privsep.daemon [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp95v154u_/privsep.sock'] Jul 23 10:20:16 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp95v154u_/privsep.sock Jul 23 10:20:16 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:18 devstack cinder-volume[88371]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 23 10:20:18 devstack cinder-volume[88371]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 10:20:18 devstack cinder-volume[88371]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 23 10:20:18 devstack cinder-volume[88371]: WARNING oslo.privsep.daemon [-] privsep log: Jul 23 10:20:18 devstack cinder-volume[88371]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 23 10:20:18 devstack cinder-volume[88371]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 23 10:20:18 devstack cinder-volume[88371]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 10:20:18 devstack cinder-volume[88371]: WARNING oslo.privsep.daemon [-] privsep log: Jul 23 10:20:18 devstack cinder-volume[88371]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 23 10:20:18 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:18 devstack cinder-volume[88371]: INFO oslo.privsep.daemon [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Spawned new privsep daemon via rootwrap Jul 23 10:20:18 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Accepted privsep connection to /tmp/tmp95v154u_/privsep.sock {{(pid=88371) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 23 10:20:18 devstack cinder-volume[88371]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 23 10:20:18 devstack cinder-volume[88371]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 23 10:20:18 devstack cinder-volume[88371]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 23 10:20:18 devstack cinder-volume[88371]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90048 Jul 23 10:20:18 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[87364da4-012b-4c02-9b0d-e4279e9d6ca9]: (2,) {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:20:18 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[04058478-e394-45a9-b85a-00f5dd5c8ec6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:20:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:20:18 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171 Jul 23 10:20:18 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:19 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171" returned: 0 in 0.694s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:20:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:20:19 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171 Jul 23 10:20:19 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:19 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f46017db-6f0b-4081-9678-a292eecc4171" returned: 0 in 0.262s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:20:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Lock "cinder-quobyte-f46017db-6f0b-4081-9678-a292eecc4171" released by "delete_volume" :: held 3.252s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:20:19 devstack cinder-volume[88371]: WARNING cinder.quota [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:20:19 devstack cinder-volume[88371]: WARNING cinder.quota [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:20:19 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Created reservations ['cfb84d2b-7501-4a89-9156-797d5f3a05dc', '9c46c7e9-ee5c-4205-b605-a8e105a2fc1d', '5cad4d2c-b567-49be-abe7-ba36f5500db6', 'cc2cf1c2-e21c-41e3-afad-2a2471f349da'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:20:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:20:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:20:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:20:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:20:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:20:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:20:19 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:20:19 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:20 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.271s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:20:20 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:20:20 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Deleted volume successfully. Jul 23 10:20:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7c468f51-f309-4d08-883a-a7345cbc892d tempest-DeleteServersTestJSON-1880762108 None] Lock "cinder-f46017db-6f0b-4081-9678-a292eecc4171-delete_volume" released by "delete_volume" :: held 3.956s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Flow 'volume_create_manager' (e1dc47c9-2788-41e5-a831-65dfba2a15c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41585dd0-4ed0-41e2-a164-22e72ae1e0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41585dd0-4ed0-41e2-a164-22e72ae1e0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-55889695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbbdbe3-903f-47f8-b63a-b50061f2a5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807f705a74ca44378ce3873043b12c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:20:21Z,use_quota=True,user_id='79f3fa455996428b831ee284550e05aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9ad253-0b4e-40fa-b7ba-5e2d6bd1e938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9ad253-0b4e-40fa-b7ba-5e2d6bd1e938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd4cd50-862f-4fba-876d-3dc41f8a3aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd4cd50-862f-4fba-876d-3dc41f8a3aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbbdbe3-903f-47f8-b63a-b50061f2a5a1', 'volume_name': 'volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18eb3511-49bf-441a-abc4-21ed85766359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18eb3511-49bf-441a-abc4-21ed85766359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303b14cc-5fe4-47fd-9884-8bb2becaec5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:21 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Volume 3bbbdbe3-903f-47f8-b63a-b50061f2a5a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1', 'volume_size': 1} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-55889695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbbdbe3-903f-47f8-b63a-b50061f2a5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807f705a74ca44378ce3873043b12c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:20:21Z,use_quota=True,user_id='79f3fa455996428b831ee284550e05aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Creating volume 3bbbdbe3-903f-47f8-b63a-b50061f2a5a1 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:20:21 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:20:21 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1 1073741824 Jul 23 10:20:21 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:21 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1 1073741824" returned: 0 in 0.568s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:20:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:20:21 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1 Jul 23 10:20:21 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:22 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1" returned: 0 in 0.377s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:20:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:20:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:20:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303b14cc-5fe4-47fd-9884-8bb2becaec5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2423a67e-d1ca-4626-860a-2c20d3b8b079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:22 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Volume volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1 (3bbbdbe3-903f-47f8-b63a-b50061f2a5a1): created successfully Jul 23 10:20:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2423a67e-d1ca-4626-860a-2c20d3b8b079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Flow 'volume_create_manager' (e1dc47c9-2788-41e5-a831-65dfba2a15c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:20:22 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6afb481b-3015-4caa-9d6f-5395c930de9c tempest-VolumesAdminNegativeTest-2147076940 None] Created volume successfully. Jul 23 10:20:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Acquiring lock "cinder-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:20:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Lock "cinder-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:20:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Acquiring lock "cinder-quobyte-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:20:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Lock "cinder-quobyte-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:20:24 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba882e6-846d-49a8-8b57-091c5b54fd03]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:20:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:20:24 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1 Jul 23 10:20:24 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:24 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1" returned: 0 in 0.602s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:20:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:20:24 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1 Jul 23 10:20:24 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:25 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1" returned: 0 in 0.353s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Lock "cinder-quobyte-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1" released by "delete_volume" :: held 1.018s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Created reservations ['62eb7a1c-7097-4208-8133-e5c48274bb2e', 'ca0cf5d4-51f0-43ad-ad7d-6de694d002e5', '8749eeeb-fda4-47cf-a1b2-91d734c04122', 'ca92f345-fdce-45f3-9905-2988897de24d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:20:25 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:20:25 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:25 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.470s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:20:25 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Deleted volume successfully. Jul 23 10:20:25 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-89a86c44-8f45-4b6a-a20f-2d75a090c9be tempest-VolumesAdminNegativeTest-2147076940 None] Lock "cinder-3bbbdbe3-903f-47f8-b63a-b50061f2a5a1-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Flow 'volume_create_manager' (5eb0a6b1-fabb-43df-97cc-268cb0b29c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99362133-020c-4f7a-910b-263f3614d748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99362133-020c-4f7a-910b-263f3614d748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1611871899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981869f0-9e26-46aa-85a7-f2aef18c198f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938e580eb0e943e6b9c277b3e623282f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:20:35Z,use_quota=True,user_id='f39748743c134d0b84b0be48b3654dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1426f29-dac0-427c-bee7-4bb668407c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1426f29-dac0-427c-bee7-4bb668407c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e68645-43b4-4182-9b75-605c2ecbf479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e68645-43b4-4182-9b75-605c2ecbf479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981869f0-9e26-46aa-85a7-f2aef18c198f', 'volume_name': 'volume-981869f0-9e26-46aa-85a7-f2aef18c198f', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d91f6d-e244-42b6-8848-d67fad9b329d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d91f6d-e244-42b6-8848-d67fad9b329d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5620853-7998-4905-b1ea-4886f4fc47dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:35 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Volume 981869f0-9e26-46aa-85a7-f2aef18c198f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981869f0-9e26-46aa-85a7-f2aef18c198f', 'volume_size': 1} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1611871899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981869f0-9e26-46aa-85a7-f2aef18c198f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938e580eb0e943e6b9c277b3e623282f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:20:35Z,use_quota=True,user_id='f39748743c134d0b84b0be48b3654dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Creating volume 981869f0-9e26-46aa-85a7-f2aef18c198f {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:20:35 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:20:35 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f 1073741824 Jul 23 10:20:35 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:35 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f 1073741824" returned: 0 in 0.625s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:20:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:20:35 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f Jul 23 10:20:35 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:36 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f" returned: 0 in 0.282s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:20:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:20:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:20:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5620853-7998-4905-b1ea-4886f4fc47dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981869f0-9e26-46aa-85a7-f2aef18c198f', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1dd1701-39b5-44e8-a5f9-6d197886dbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:20:36 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Volume volume-981869f0-9e26-46aa-85a7-f2aef18c198f (981869f0-9e26-46aa-85a7-f2aef18c198f): created successfully Jul 23 10:20:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1dd1701-39b5-44e8-a5f9-6d197886dbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:20:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Flow 'volume_create_manager' (5eb0a6b1-fabb-43df-97cc-268cb0b29c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:20:36 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-10ca1508-1f2d-4a98-bf21-a020129f4393 tempest-ServerActionsTestOtherA-466966482 None] Created volume successfully. Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:20:46 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:20:46 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=23,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=4 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:20:46 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.397s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 8 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:20:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:21:06 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=1 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:21:06 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=1 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Flow 'volume_create_manager' (6ddf25d1-5733-49ad-a434-1f4ea88e2cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a44b51f-b95c-4257-a2a7-d7668f0d846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a44b51f-b95c-4257-a2a7-d7668f0d846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-788187437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e09fea0-bffb-4556-8d44-bfd23b8dfd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7fcf6e4e83f4b25b0c2b67241e18448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:14Z,use_quota=True,user_id='f0aea295ee41476890c3a92f37750371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6ef81e-727b-4eca-85fa-afe523b1e028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6ef81e-727b-4eca-85fa-afe523b1e028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a778165-f18f-4e3c-b3f5-34f752cd45ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a778165-f18f-4e3c-b3f5-34f752cd45ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e09fea0-bffb-4556-8d44-bfd23b8dfd50', 'volume_name': 'volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046e3899-b075-47fc-bd99-01aa119758ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046e3899-b075-47fc-bd99-01aa119758ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2776f1c-af12-4ca2-8d73-1e7e9a4eda24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:13 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Volume 2e09fea0-bffb-4556-8d44-bfd23b8dfd50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50', 'volume_size': 1} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-788187437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e09fea0-bffb-4556-8d44-bfd23b8dfd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7fcf6e4e83f4b25b0c2b67241e18448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:14Z,use_quota=True,user_id='f0aea295ee41476890c3a92f37750371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Creating volume 2e09fea0-bffb-4556-8d44-bfd23b8dfd50 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:21:13 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:21:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:13 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50 1073741824 Jul 23 10:21:13 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:14 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50 1073741824" returned: 0 in 0.527s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:14 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50 Jul 23 10:21:14 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:15 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50" returned: 0 in 0.521s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:21:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2776f1c-af12-4ca2-8d73-1e7e9a4eda24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf63d75-80b5-4be5-9981-e4c4dbc8f00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:15 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Volume volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50 (2e09fea0-bffb-4556-8d44-bfd23b8dfd50): created successfully Jul 23 10:21:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf63d75-80b5-4be5-9981-e4c4dbc8f00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Flow 'volume_create_manager' (6ddf25d1-5733-49ad-a434-1f4ea88e2cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b5a11f78-6cf0-4410-bfde-b991e402f448 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Created volume successfully. Jul 23 10:21:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Acquiring lock "cinder-2e09fea0-bffb-4556-8d44-bfd23b8dfd50-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Lock "cinder-2e09fea0-bffb-4556-8d44-bfd23b8dfd50-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Acquiring lock "cinder-quobyte-2e09fea0-bffb-4556-8d44-bfd23b8dfd50" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Lock "cinder-quobyte-2e09fea0-bffb-4556-8d44-bfd23b8dfd50" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:17 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39a409e-d982-4307-8630-29246872f152]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:21:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:17 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50 Jul 23 10:21:17 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:18 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50" returned: 0 in 0.431s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:18 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50 Jul 23 10:21:18 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:18 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e09fea0-bffb-4556-8d44-bfd23b8dfd50" returned: 0 in 0.285s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Lock "cinder-quobyte-2e09fea0-bffb-4556-8d44-bfd23b8dfd50" released by "delete_volume" :: held 0.765s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Created reservations ['fc3499a0-3937-4854-bc01-fbee12a5e04d', '5dbf729f-8d77-455c-ad3d-771cd29343fc', 'c3beb561-3dc8-4234-993c-a1d1b4746d6b', '164b9c88-c635-4b7d-a2f3-0bfaa77dbf21'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:18 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:21:18 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:18 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.416s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:21:18 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Deleted volume successfully. Jul 23 10:21:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-96fcfa4b-d3ab-420b-ace0-74305fbe37c7 tempest-VolumeQuotasNegativeTestJSON-1335479599 None] Lock "cinder-2e09fea0-bffb-4556-8d44-bfd23b8dfd50-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Flow 'volume_create_manager' (a339678d-ea0e-40cd-b83b-cfb6d1186ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c7aa1c-215a-4fe6-b2bf-7e2f441a800e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c7aa1c-215a-4fe6-b2bf-7e2f441a800e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1207936432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb01856-2e1b-4565-8a3c-6258522f5829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4400bd39aa8e4ad5bc7776ddb8fbe0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:20Z,use_quota=True,user_id='20c172b29c1c41f6a7849bf52bb9bbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c2f356-e14e-45eb-a81b-41ab194cb989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c2f356-e14e-45eb-a81b-41ab194cb989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988f2a69-0b46-4953-bb2d-ed430933687e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988f2a69-0b46-4953-bb2d-ed430933687e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb01856-2e1b-4565-8a3c-6258522f5829', 'volume_name': 'volume-3fb01856-2e1b-4565-8a3c-6258522f5829', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6db9b5b-cedc-4caa-b759-fc356188ed3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6db9b5b-cedc-4caa-b759-fc356188ed3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11782f30-8010-428f-8860-a023dee4bc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:20 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Volume 3fb01856-2e1b-4565-8a3c-6258522f5829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb01856-2e1b-4565-8a3c-6258522f5829', 'volume_size': 1} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1207936432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb01856-2e1b-4565-8a3c-6258522f5829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4400bd39aa8e4ad5bc7776ddb8fbe0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:20Z,use_quota=True,user_id='20c172b29c1c41f6a7849bf52bb9bbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Creating volume 3fb01856-2e1b-4565-8a3c-6258522f5829 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:21:20 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:21:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:20 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829 1073741824 Jul 23 10:21:20 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:21 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829 1073741824" returned: 0 in 0.709s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:21 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829 Jul 23 10:21:21 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:21 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829" returned: 0 in 0.340s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:21:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11782f30-8010-428f-8860-a023dee4bc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb01856-2e1b-4565-8a3c-6258522f5829', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb2e33e-cf43-4f05-8c37-d384f2c8d1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:21 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Volume volume-3fb01856-2e1b-4565-8a3c-6258522f5829 (3fb01856-2e1b-4565-8a3c-6258522f5829): created successfully Jul 23 10:21:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb2e33e-cf43-4f05-8c37-d384f2c8d1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Flow 'volume_create_manager' (a339678d-ea0e-40cd-b83b-cfb6d1186ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:21 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-51f2b9c7-0ba1-4d0b-a824-03684b94cd36 tempest-ServersNegativeTestJSON-1075613139 None] Created volume successfully. Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Flow 'volume_create_manager' (6ed3c4f0-2ad1-4827-9ab0-aba8c0d647b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c10816-e063-4f8f-9e8f-3e2640094c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c10816-e063-4f8f-9e8f-3e2640094c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1021180940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1385439b-52c7-48a4-b3fa-1713f217946e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4400bd39aa8e4ad5bc7776ddb8fbe0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:24Z,use_quota=True,user_id='20c172b29c1c41f6a7849bf52bb9bbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd15f126-4c31-4224-ae93-cfcf090b87f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd15f126-4c31-4224-ae93-cfcf090b87f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ffdf36-1fd3-4540-8eec-2310579780d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ffdf36-1fd3-4540-8eec-2310579780d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1385439b-52c7-48a4-b3fa-1713f217946e', 'volume_name': 'volume-1385439b-52c7-48a4-b3fa-1713f217946e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f00c93-71f1-46a0-9917-a4adab814cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f00c93-71f1-46a0-9917-a4adab814cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6eedb4-be7c-4f68-a7c7-b78bd71d9003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:24 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Volume 1385439b-52c7-48a4-b3fa-1713f217946e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1385439b-52c7-48a4-b3fa-1713f217946e', 'volume_size': 1} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1021180940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1385439b-52c7-48a4-b3fa-1713f217946e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4400bd39aa8e4ad5bc7776ddb8fbe0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:24Z,use_quota=True,user_id='20c172b29c1c41f6a7849bf52bb9bbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Creating volume 1385439b-52c7-48a4-b3fa-1713f217946e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:21:24 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:21:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:24 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e 1073741824 Jul 23 10:21:24 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:25 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e 1073741824" returned: 0 in 0.725s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:25 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e Jul 23 10:21:25 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-d71f6719-cab3-4bf4-aee7-f214a7cde500 req-9ead1c91-e369-4301-9412-70ede6c3d41b tempest-ServerActionsTestOtherA-466966482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:25 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e" returned: 0 in 0.344s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-d71f6719-cab3-4bf4-aee7-f214a7cde500 req-9ead1c91-e369-4301-9412-70ede6c3d41b tempest-ServerActionsTestOtherA-466966482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.205s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6eedb4-be7c-4f68-a7c7-b78bd71d9003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1385439b-52c7-48a4-b3fa-1713f217946e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe65b08-6de7-4e6c-8f1d-08b7ad8cfc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-d71f6719-cab3-4bf4-aee7-f214a7cde500 req-9ead1c91-e369-4301-9412-70ede6c3d41b tempest-ServerActionsTestOtherA-466966482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.172s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:25 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Volume volume-1385439b-52c7-48a4-b3fa-1713f217946e (1385439b-52c7-48a4-b3fa-1713f217946e): created successfully Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe65b08-6de7-4e6c-8f1d-08b7ad8cfc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Flow 'volume_create_manager' (6ed3c4f0-2ad1-4827-9ab0-aba8c0d647b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:25 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f7edffad-54be-4699-a2b4-46b3258a333b tempest-ServersNegativeTestJSON-1075613139 None] Created volume successfully. Jul 23 10:21:25 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-d71f6719-cab3-4bf4-aee7-f214a7cde500 req-9ead1c91-e369-4301-9412-70ede6c3d41b tempest-ServerActionsTestOtherA-466966482 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-981869f0-9e26-46aa-85a7-f2aef18c198f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2096c64e-748c-4ae0-bb5c-d731357eb5c7', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:21:25 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-d71f6719-cab3-4bf4-aee7-f214a7cde500 req-9ead1c91-e369-4301-9412-70ede6c3d41b tempest-ServerActionsTestOtherA-466966482 None] attachment_update completed successfully. Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Flow 'volume_create_manager' (9f5caa85-9cba-49ab-8504-0fcedfa442d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d276653-fd7b-4888-9ce4-d621b4e57827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d276653-fd7b-4888-9ce4-d621b4e57827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-163271979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=021389ee-1475-4385-9e5b-dfb553063a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e346796f72ad4b9ab3b5f1ed2dd98a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:27Z,use_quota=True,user_id='2e1f48c633e14344915131b95d0e643f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a164600-f428-465c-be83-88ed0dc3a38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a164600-f428-465c-be83-88ed0dc3a38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c644ae5-8c49-4695-a468-cd4cef7110f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c644ae5-8c49-4695-a468-cd4cef7110f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '021389ee-1475-4385-9e5b-dfb553063a6d', 'volume_name': 'volume-021389ee-1475-4385-9e5b-dfb553063a6d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ae6504-d216-4c84-80ac-0d0eb4b8e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ae6504-d216-4c84-80ac-0d0eb4b8e531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c50fee-df27-40ed-bbb1-c92443c12f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:27 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Volume 021389ee-1475-4385-9e5b-dfb553063a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-021389ee-1475-4385-9e5b-dfb553063a6d', 'volume_size': 1} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-163271979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=021389ee-1475-4385-9e5b-dfb553063a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e346796f72ad4b9ab3b5f1ed2dd98a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:27Z,use_quota=True,user_id='2e1f48c633e14344915131b95d0e643f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Creating volume 021389ee-1475-4385-9e5b-dfb553063a6d {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:21:27 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:27 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d 1073741824 Jul 23 10:21:27 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Acquiring lock "cinder-1385439b-52c7-48a4-b3fa-1713f217946e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Lock "cinder-1385439b-52c7-48a4-b3fa-1713f217946e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Acquiring lock "cinder-quobyte-1385439b-52c7-48a4-b3fa-1713f217946e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Lock "cinder-quobyte-1385439b-52c7-48a4-b3fa-1713f217946e" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[970e1831-dc38-4359-ae0d-bb6b336b6356]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:27 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e Jul 23 10:21:27 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:27 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d 1073741824" returned: 0 in 0.672s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:27 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e" returned: 0 in 0.443s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:27 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e Jul 23 10:21:27 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d Jul 23 10:21:27 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:27 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:28 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:28 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1385439b-52c7-48a4-b3fa-1713f217946e" returned: 0 in 0.338s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d" returned: 0 in 0.330s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Lock "cinder-quobyte-1385439b-52c7-48a4-b3fa-1713f217946e" released by "delete_volume" :: held 0.844s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c50fee-df27-40ed-bbb1-c92443c12f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-021389ee-1475-4385-9e5b-dfb553063a6d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d664ca0-442e-4c43-b39f-3dd25c59becc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:28 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Volume volume-021389ee-1475-4385-9e5b-dfb553063a6d (021389ee-1475-4385-9e5b-dfb553063a6d): created successfully Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d664ca0-442e-4c43-b39f-3dd25c59becc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Flow 'volume_create_manager' (9f5caa85-9cba-49ab-8504-0fcedfa442d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:28 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4748630c-c289-451f-9d7b-0d2962ee499c tempest-VolumesServicesTestJSON-141999048 None] Created volume successfully. Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Created reservations ['2d038c36-95ba-437e-8271-77d0dc5c9de9', 'db133efa-a2b3-4708-ab8e-65be28e58bbf', '2563ff6c-42a0-4cdc-ab56-922c30c16b12', '4bcc480b-2398-4f4a-a2c7-1ed235e68a6e'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:28 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:21:28 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Acquiring lock "cinder-3fb01856-2e1b-4565-8a3c-6258522f5829-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Lock "cinder-3fb01856-2e1b-4565-8a3c-6258522f5829-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Acquiring lock "cinder-quobyte-3fb01856-2e1b-4565-8a3c-6258522f5829" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Lock "cinder-quobyte-3fb01856-2e1b-4565-8a3c-6258522f5829" acquired by "delete_volume" :: waited 0.036s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4247551b-a6c8-4833-9b9b-094fbc7e93b4]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:28 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.478s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:21:28 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Deleted volume successfully. Jul 23 10:21:28 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829 Jul 23 10:21:28 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-787c51fc-aa96-4931-bec8-07c6ddc124a4 tempest-ServersNegativeTestJSON-1075613139 None] Lock "cinder-1385439b-52c7-48a4-b3fa-1713f217946e-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:29 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829" returned: 0 in 0.630s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:29 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829 Jul 23 10:21:29 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Acquiring lock "cinder-021389ee-1475-4385-9e5b-dfb553063a6d-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Lock "cinder-021389ee-1475-4385-9e5b-dfb553063a6d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Acquiring lock "cinder-quobyte-021389ee-1475-4385-9e5b-dfb553063a6d" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Lock "cinder-quobyte-021389ee-1475-4385-9e5b-dfb553063a6d" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:29 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f9224f-50c0-4254-a03e-6a303d70a73a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:21:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:29 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3fb01856-2e1b-4565-8a3c-6258522f5829" returned: 0 in 0.392s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Lock "cinder-quobyte-3fb01856-2e1b-4565-8a3c-6258522f5829" released by "delete_volume" :: held 1.105s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:29 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d Jul 23 10:21:29 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:29 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Created reservations ['079ad40c-099a-4747-90aa-681888041c8d', '925e0169-4f53-4d21-9e02-1bd9a3b2bfc0', '96a0b0b9-f093-45c2-9b68-334b36e6bc3e', '14183a8c-c6cc-4053-b5b2-d4404f75e7ca'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:30 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-6fe722c3-6472-4aab-99dc-b43546c154f2 req-98950fa2-be5f-4956-bf16-68cc24e6b8e2 tempest-ServerActionsTestOtherA-466966482 None] Terminate volume connection completed successfully. Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-6fe722c3-6472-4aab-99dc-b43546c154f2 req-98950fa2-be5f-4956-bf16-68cc24e6b8e2 tempest-ServerActionsTestOtherA-466966482 None] Deleting attachment 2096c64e-748c-4ae0-bb5c-d731357eb5c7. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:21:30 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:21:30 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:30 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d" returned: 0 in 0.647s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:30 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d Jul 23 10:21:30 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:30 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.496s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:21:30 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Deleted volume successfully. Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c707a0a5-b0da-47bd-aaf6-4db3cf9f2ddc tempest-ServersNegativeTestJSON-1075613139 None] Lock "cinder-3fb01856-2e1b-4565-8a3c-6258522f5829-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:30 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-021389ee-1475-4385-9e5b-dfb553063a6d" returned: 0 in 0.399s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Lock "cinder-quobyte-021389ee-1475-4385-9e5b-dfb553063a6d" released by "delete_volume" :: held 1.119s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Created reservations ['315da880-9979-4dfd-b964-0442fd0d614b', '2122f726-7c6a-43ba-a310-5ca215ddff6d', '0c5d4ccf-9514-47e9-a8aa-1295a165ccac', 'c0026b0e-99ea-4b56-9a36-1dcc69da5332'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:30 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:21:30 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-6fe722c3-6472-4aab-99dc-b43546c154f2 req-2b673751-e6cb-4626-9cfe-62093a87c290 tempest-ServerActionsTestOtherA-466966482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-6fe722c3-6472-4aab-99dc-b43546c154f2 req-2b673751-e6cb-4626-9cfe-62093a87c290 tempest-ServerActionsTestOtherA-466966482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-6fe722c3-6472-4aab-99dc-b43546c154f2 req-2b673751-e6cb-4626-9cfe-62093a87c290 tempest-ServerActionsTestOtherA-466966482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-6fe722c3-6472-4aab-99dc-b43546c154f2 req-2b673751-e6cb-4626-9cfe-62093a87c290 tempest-ServerActionsTestOtherA-466966482 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-981869f0-9e26-46aa-85a7-f2aef18c198f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b31ad1c-b3b3-42d9-8bb8-8fc137db1d11', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:21:31 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.333s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:31 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:21:31 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Deleted volume successfully. Jul 23 10:21:31 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-6fe722c3-6472-4aab-99dc-b43546c154f2 req-2b673751-e6cb-4626-9cfe-62093a87c290 tempest-ServerActionsTestOtherA-466966482 None] attachment_update completed successfully. Jul 23 10:21:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-127d736b-d64f-46d1-9572-f43464e9871c tempest-VolumesServicesTestJSON-141999048 None] Lock "cinder-021389ee-1475-4385-9e5b-dfb553063a6d-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Flow 'volume_create_manager' (9e4c75e6-3aa4-465a-9c9c-2a57013bbb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a9f9bd-4a59-4a44-ad14-5453f73e6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a9f9bd-4a59-4a44-ad14-5453f73e6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1747443291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192fa56b-3099-4808-be6e-d2f308cbfe69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f2c2aba7cf4cce82c1a798a501a102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:36Z,use_quota=True,user_id='b0020c4f827548f1a058374507a01956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8916f38-f477-4420-8a5f-062714403514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8916f38-f477-4420-8a5f-062714403514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8424a2-591e-45a4-a8b0-a530cc53531c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8424a2-591e-45a4-a8b0-a530cc53531c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192fa56b-3099-4808-be6e-d2f308cbfe69', 'volume_name': 'volume-192fa56b-3099-4808-be6e-d2f308cbfe69', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572d2404-1855-4913-abd6-f6ca820a9ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572d2404-1855-4913-abd6-f6ca820a9ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968ac281-7b23-40c7-a8cc-a5281227d143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:35 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Volume 192fa56b-3099-4808-be6e-d2f308cbfe69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192fa56b-3099-4808-be6e-d2f308cbfe69', 'volume_size': 1} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1747443291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192fa56b-3099-4808-be6e-d2f308cbfe69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f2c2aba7cf4cce82c1a798a501a102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:36Z,use_quota=True,user_id='b0020c4f827548f1a058374507a01956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Creating volume 192fa56b-3099-4808-be6e-d2f308cbfe69 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:21:35 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:21:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:35 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69 1073741824 Jul 23 10:21:35 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:36 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69 1073741824" returned: 0 in 0.804s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:36 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69 Jul 23 10:21:36 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:37 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69" returned: 0 in 0.320s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:21:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968ac281-7b23-40c7-a8cc-a5281227d143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192fa56b-3099-4808-be6e-d2f308cbfe69', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6d7f22-6289-4ca6-b98c-0499e9681ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:37 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Volume volume-192fa56b-3099-4808-be6e-d2f308cbfe69 (192fa56b-3099-4808-be6e-d2f308cbfe69): created successfully Jul 23 10:21:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6d7f22-6289-4ca6-b98c-0499e9681ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Flow 'volume_create_manager' (9e4c75e6-3aa4-465a-9c9c-2a57013bbb43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:37 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-02434bd2-f8ef-4050-ab3b-c6794e11afe8 tempest-TaggedAttachmentsTest-848787705 None] Created volume successfully. Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Flow 'volume_create_manager' (8e70068f-4050-4666-a589-a022acfd1852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c043e2-dd49-4049-9634-2e6417521465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c043e2-dd49-4049-9634-2e6417521465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1395142738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a25094e-4e3f-4291-a47e-c27f410cb92d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2cbdfdcf12e4b02b20b2d73a804d38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:46Z,use_quota=True,user_id='86a24349d0ad40bab8c3b4528cceecfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e219dc8-d6fe-41d8-aa0f-70cebd66eb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e219dc8-d6fe-41d8-aa0f-70cebd66eb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d059d6-338d-474e-bf5a-ac2be7fd3ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d059d6-338d-474e-bf5a-ac2be7fd3ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a25094e-4e3f-4291-a47e-c27f410cb92d', 'volume_name': 'volume-9a25094e-4e3f-4291-a47e-c27f410cb92d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd33e39-77d0-4b15-9648-a2f600e71c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd33e39-77d0-4b15-9648-a2f600e71c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ac9d89-0a07-49d0-95f1-b1be864af82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:46 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Volume 9a25094e-4e3f-4291-a47e-c27f410cb92d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a25094e-4e3f-4291-a47e-c27f410cb92d', 'volume_size': 1} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1395142738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a25094e-4e3f-4291-a47e-c27f410cb92d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2cbdfdcf12e4b02b20b2d73a804d38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:46Z,use_quota=True,user_id='86a24349d0ad40bab8c3b4528cceecfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Creating volume 9a25094e-4e3f-4291-a47e-c27f410cb92d {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:21:46 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:46 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d 1073741824 Jul 23 10:21:46 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:46 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:21:46 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:46 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.394s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:21:46 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d 1073741824" returned: 0 in 0.688s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:46 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d Jul 23 10:21:46 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:47 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d" returned: 0 in 0.380s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:21:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ac9d89-0a07-49d0-95f1-b1be864af82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a25094e-4e3f-4291-a47e-c27f410cb92d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8032bb2-fdc4-4dbd-b265-a1444340027b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:47 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Volume volume-9a25094e-4e3f-4291-a47e-c27f410cb92d (9a25094e-4e3f-4291-a47e-c27f410cb92d): created successfully Jul 23 10:21:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8032bb2-fdc4-4dbd-b265-a1444340027b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Flow 'volume_create_manager' (8e70068f-4050-4666-a589-a022acfd1852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:47 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-9747888b-58d7-483b-a9ba-3bcb9dd94fbe req-28ed5e02-534b-4ba8-b485-b01a728554c4 tempest-VolumesGetTestJSON-1605179747 None] Created volume successfully. Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Flow 'volume_create_manager' (ddb9b6b5-2dca-4ab7-a66b-2c192feddf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163d76d2-731e-4364-9f84-58720526d927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163d76d2-731e-4364-9f84-58720526d927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-100856557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c17b222-1fc7-4226-a1bd-a0dade79ffd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2bda5d32bf4bb1bdbf98b55b0bc338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:48Z,use_quota=True,user_id='a41195767762468796c4afa276ebb9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4be724f-849e-42b8-931f-0687645d3e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4be724f-849e-42b8-931f-0687645d3e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9443956-adbb-45e3-9b57-46362a93b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9443956-adbb-45e3-9b57-46362a93b06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c17b222-1fc7-4226-a1bd-a0dade79ffd9', 'volume_name': 'volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3b381b-93c6-4e1a-956a-56f928dfaa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3b381b-93c6-4e1a-956a-56f928dfaa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbdff32-cb94-4a33-b99f-6a82a6cfb2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:48 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Volume 6c17b222-1fc7-4226-a1bd-a0dade79ffd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9', 'volume_size': 1} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-100856557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c17b222-1fc7-4226-a1bd-a0dade79ffd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2bda5d32bf4bb1bdbf98b55b0bc338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:21:48Z,use_quota=True,user_id='a41195767762468796c4afa276ebb9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Creating volume 6c17b222-1fc7-4226-a1bd-a0dade79ffd9 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:21:48 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:21:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:48 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 1073741824 Jul 23 10:21:48 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Acquiring lock "cinder-9a25094e-4e3f-4291-a47e-c27f410cb92d-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Lock "cinder-9a25094e-4e3f-4291-a47e-c27f410cb92d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Acquiring lock "cinder-quobyte-9a25094e-4e3f-4291-a47e-c27f410cb92d" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Lock "cinder-quobyte-9a25094e-4e3f-4291-a47e-c27f410cb92d" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[50728d6b-693e-422f-977d-1f6a8b6fc6bd]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:49 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 1073741824" returned: 0 in 1.082s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:49 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 Jul 23 10:21:49 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:49 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d Jul 23 10:21:49 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:49 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9" returned: 0 in 0.336s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbdff32-cb94-4a33-b99f-6a82a6cfb2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02504039-e70c-4657-8c5f-82a8e0394c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:21:49 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Volume volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 (6c17b222-1fc7-4226-a1bd-a0dade79ffd9): created successfully Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02504039-e70c-4657-8c5f-82a8e0394c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:21:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Flow 'volume_create_manager' (ddb9b6b5-2dca-4ab7-a66b-2c192feddf0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:21:49 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-85582e91-de57-4795-b2c7-01e826abce15 tempest-SnapshotMetadataTestJSON-1287485023 None] Created volume successfully. Jul 23 10:21:50 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d" returned: 0 in 0.649s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:50 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d Jul 23 10:21:50 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:50 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a25094e-4e3f-4291-a47e-c27f410cb92d" returned: 0 in 0.270s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Lock "cinder-quobyte-9a25094e-4e3f-4291-a47e-c27f410cb92d" released by "delete_volume" :: held 0.998s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG cinder.quota [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Created reservations ['a28a1a25-1378-4811-8c95-fee0faaf0b91', '44d829a6-b873-46a3-9530-a1646505dedd', 'f227fe8f-cbff-4bf4-b8dd-4de31bbe1a1a', '43dbc7dc-db08-4bfc-8b40-ea7546a1f07f'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:50 devstack sudo[91821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:21:50 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] Creating offline snapshot 77231941-bbae-4929-97f3-21bb20c0161e of volume 6c17b222-1fc7-4226-a1bd-a0dade79ffd9 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[18323c7f-14ff-478b-97a5-cc87e89f55cc]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:50 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.303s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG cinder.manager [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:21:50 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Deleted volume successfully. Jul 23 10:21:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-661ddcb1-57e5-4f16-974f-f1771ed01b93 req-50baec35-3ba9-46b3-b7e4-eab7e720e311 tempest-VolumesGetTestJSON-1605179747 None] Lock "cinder-9a25094e-4e3f-4291-a47e-c27f410cb92d-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:50 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 Jul 23 10:21:50 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:51 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9" returned: 0 in 0.392s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:51 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e 1G Jul 23 10:21:51 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:51 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e 1G" returned: 0 in 0.436s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:51 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e Jul 23 10:21:51 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:52 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e" returned: 0 in 0.437s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:52 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e is being set with open permissions: ugo+rw Jul 23 10:21:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:52 devstack sudo[91857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e Jul 23 10:21:52 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:52 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e" returned: 0 in 0.385s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:52 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.info Jul 23 10:21:52 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:52 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.info" returned: 0 in 0.384s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:52 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.info is being set with open permissions: ugo+rw Jul 23 10:21:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:52 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.info Jul 23 10:21:52 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:53 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.info" returned: 0 in 0.402s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1c44a546-1e8a-4527-a8be-7cbd15a1a11c tempest-SnapshotMetadataTestJSON-1287485023 None] Create snapshot completed successfully Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Acquiring lock "cinder-77231941-bbae-4929-97f3-21bb20c0161e-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "cinder-77231941-bbae-4929-97f3-21bb20c0161e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Acquiring lock "cinder-quobyte-6c17b222-1fc7-4226-a1bd-a0dade79ffd9" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "cinder-quobyte-6c17b222-1fc7-4226-a1bd-a0dade79ffd9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Acquiring lock "cinder-quobyte-77231941-bbae-4929-97f3-21bb20c0161e" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "cinder-quobyte-77231941-bbae-4929-97f3-21bb20c0161e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Deleting offline snapshot 77231941-bbae-4929-97f3-21bb20c0161e of volume 6c17b222-1fc7-4226-a1bd-a0dade79ffd9 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] snapshot_file for this snap is: volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b57b355-d81a-40c8-97b5-aaeb16c96494]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:55 devstack sudo[91915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e Jul 23 10:21:55 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:55 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e" returned: 0 in 0.488s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6816c12-f7cc-4a9f-8e3e-bfe5009baeb0]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:21:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:55 devstack sudo[91922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 Jul 23 10:21:55 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:56 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9" returned: 0 in 0.593s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:56 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e Jul 23 10:21:56 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:56 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e" returned: 0 in 0.460s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:56 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e Jul 23 10:21:56 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:57 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9.77231941-bbae-4929-97f3-21bb20c0161e" returned: 0 in 0.344s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "cinder-quobyte-77231941-bbae-4929-97f3-21bb20c0161e" released by "_delete_snapshot" :: held 2.043s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "cinder-quobyte-6c17b222-1fc7-4226-a1bd-a0dade79ffd9" released by "delete_snapshot" :: held 2.069s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:57 devstack cinder-volume[88371]: WARNING cinder.quota [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:21:57 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Created reservations ['d281f1da-59a2-4635-8b87-95c44e56fe19', '6bb845ef-3cde-47f5-904d-5b3d64f95837', '57359419-69a9-4ed8-a4dd-7d8b74252beb', 'fc32b006-e4e6-470f-9971-6a7940312495'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:21:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Delete snapshot completed successfully. Jul 23 10:21:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7dbb15b9-18b7-4d3f-813c-06ebc7c09fa6 tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "cinder-77231941-bbae-4929-97f3-21bb20c0161e-delete_snapshot" released by "delete_snapshot" :: held 2.346s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Acquiring lock "cinder-6c17b222-1fc7-4226-a1bd-a0dade79ffd9-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "cinder-6c17b222-1fc7-4226-a1bd-a0dade79ffd9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Acquiring lock "cinder-quobyte-6c17b222-1fc7-4226-a1bd-a0dade79ffd9" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:21:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "cinder-quobyte-6c17b222-1fc7-4226-a1bd-a0dade79ffd9" acquired by "delete_volume" :: waited 0.040s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:21:58 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7c1c41-fc13-4a04-8020-4aec552931fe]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:21:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:58 devstack sudo[91937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 Jul 23 10:21:58 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:59 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9" returned: 0 in 0.441s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:59 devstack sudo[91942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9 Jul 23 10:21:59 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:21:59 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root Jul 23 10:21:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6c17b222-1fc7-4226-a1bd-a0dade79ffd9" returned: 0 in 0.360s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:21:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "cinder-quobyte-6c17b222-1fc7-4226-a1bd-a0dade79ffd9" released by "delete_volume" :: held 0.907s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:21:59 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Created reservations ['0c53dfb3-6699-4473-bb75-2e4102c6d92e', 'e09b4e78-0858-41ac-ac76-a1259d39180a', '2440d4b8-6c16-4449-bb08-a8b98b884ba9', 'de613f12-18f5-4f2f-919a-7cff0adcf64a'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:21:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:21:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:21:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:21:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:21:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:21:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:21:59 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:21:59 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:00 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.578s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:00 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Deleted volume successfully. Jul 23 10:22:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-938aa62f-3a54-435a-92de-a2a5d6bd18bc tempest-SnapshotMetadataTestJSON-1287485023 None] Lock "cinder-6c17b222-1fc7-4226-a1bd-a0dade79ffd9-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:02 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-88376175-ffa6-4665-8c12-acd6c242c69e req-73cd252b-14c8-440c-88db-d600b9ea89fe tempest-ServerActionsTestOtherA-466966482 None] Terminate volume connection completed successfully. Jul 23 10:22:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-88376175-ffa6-4665-8c12-acd6c242c69e req-73cd252b-14c8-440c-88db-d600b9ea89fe tempest-ServerActionsTestOtherA-466966482 None] Deleting attachment 6b31ad1c-b3b3-42d9-8bb8-8fc137db1d11. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:22:05 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:22:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Flow 'volume_create_manager' (e83bdd72-958d-49fc-94ef-24203df9f41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd55f19-377f-4ada-bd22-206ce4a7d3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd55f19-377f-4ada-bd22-206ce4a7d3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-663198287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bd7473-e14f-4f03-9b43-7d91892a8b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8429008bac3a460f8fc6f038e0535d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:06Z,use_quota=True,user_id='c6130425539341e6baf800a3a44b5bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c00bf1e-f18f-4a77-9a4c-47476c0879b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c00bf1e-f18f-4a77-9a4c-47476c0879b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece240d1-1c39-4cc4-94ed-c9cb59d377f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece240d1-1c39-4cc4-94ed-c9cb59d377f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bd7473-e14f-4f03-9b43-7d91892a8b57', 'volume_name': 'volume-94bd7473-e14f-4f03-9b43-7d91892a8b57', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633aa6d3-29d4-43e7-ae7b-5b504fcb831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633aa6d3-29d4-43e7-ae7b-5b504fcb831c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c529c8-7db9-418a-b80b-dba46dc88b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:06 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Volume 94bd7473-e14f-4f03-9b43-7d91892a8b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bd7473-e14f-4f03-9b43-7d91892a8b57', 'volume_size': 1} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-663198287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bd7473-e14f-4f03-9b43-7d91892a8b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8429008bac3a460f8fc6f038e0535d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:06Z,use_quota=True,user_id='c6130425539341e6baf800a3a44b5bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Creating volume 94bd7473-e14f-4f03-9b43-7d91892a8b57 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:22:06 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:06 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57 1073741824 Jul 23 10:22:06 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:06 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57 1073741824" returned: 0 in 0.564s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=80,cinder:SELECT=74,cinder:INSERT=20,cinder:DELETE=8 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=66,cinder:UPDATE=79,cinder:DELETE=6,cinder:INSERT=16 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Flow 'volume_create_manager' (be1ca067-9add-421e-9862-def4bac5ec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1495f9-3032-448a-aead-443ac03ebab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1495f9-3032-448a-aead-443ac03ebab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1032663799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb8c27d-1357-4b05-86e5-c932d4bc89b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502452782fb74b21ad719fcdb3a9d816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:07Z,use_quota=True,user_id='5d5fc920dcce4ba89028334e3ac715f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f1d29c-547f-461a-9196-72bd9c6a4ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f1d29c-547f-461a-9196-72bd9c6a4ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:06 devstack sudo[92027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57 Jul 23 10:22:06 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2957e71-4cb7-4b65-bec3-a3943056c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2957e71-4cb7-4b65-bec3-a3943056c445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb8c27d-1357-4b05-86e5-c932d4bc89b1', 'volume_name': 'volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c893530-3fa9-4b17-a96d-0b51d18173d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c893530-3fa9-4b17-a96d-0b51d18173d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a957f92f-3c47-4b83-a195-b5a0ff2fea38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:06 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Volume acb8c27d-1357-4b05-86e5-c932d4bc89b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1', 'volume_size': 1} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:06 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57" returned: 0 in 0.268s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.216s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1032663799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb8c27d-1357-4b05-86e5-c932d4bc89b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502452782fb74b21ad719fcdb3a9d816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:07Z,use_quota=True,user_id='5d5fc920dcce4ba89028334e3ac715f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Creating volume acb8c27d-1357-4b05-86e5-c932d4bc89b1 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:22:06 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:22:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c529c8-7db9-418a-b80b-dba46dc88b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bd7473-e14f-4f03-9b43-7d91892a8b57', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:07 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1 1073741824 Jul 23 10:22:07 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802013c8-7be7-479e-b3c6-903e2e23465c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:07 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Volume volume-94bd7473-e14f-4f03-9b43-7d91892a8b57 (94bd7473-e14f-4f03-9b43-7d91892a8b57): created successfully Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802013c8-7be7-479e-b3c6-903e2e23465c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Flow 'volume_create_manager' (e83bdd72-958d-49fc-94ef-24203df9f41b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-14c99b23-ef88-42ce-a4f6-c1fde58602f7 tempest-AbsoluteLimitsTests-1910333430 None] Created volume successfully. Jul 23 10:22:07 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1 1073741824" returned: 0 in 0.440s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:07 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1 Jul 23 10:22:07 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:07 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1" returned: 0 in 0.242s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a957f92f-3c47-4b83-a195-b5a0ff2fea38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba01c37-7033-444e-89c4-03ff34e4acba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:07 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Volume volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1 (acb8c27d-1357-4b05-86e5-c932d4bc89b1): created successfully Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba01c37-7033-444e-89c4-03ff34e4acba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Flow 'volume_create_manager' (be1ca067-9add-421e-9862-def4bac5ec8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5b07d662-7592-496c-b5b6-28df7dabf092 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Created volume successfully. Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Acquiring lock "cinder-94bd7473-e14f-4f03-9b43-7d91892a8b57-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Lock "cinder-94bd7473-e14f-4f03-9b43-7d91892a8b57-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Acquiring lock "cinder-quobyte-94bd7473-e14f-4f03-9b43-7d91892a8b57" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Lock "cinder-quobyte-94bd7473-e14f-4f03-9b43-7d91892a8b57" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc682d1b-c573-433b-8278-d4d45ca87f72]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:08 devstack sudo[92040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57 Jul 23 10:22:08 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:08 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57" returned: 0 in 0.416s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:08 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57 Jul 23 10:22:08 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Acquiring lock "cinder-acb8c27d-1357-4b05-86e5-c932d4bc89b1-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "cinder-acb8c27d-1357-4b05-86e5-c932d4bc89b1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Acquiring lock "cinder-quobyte-acb8c27d-1357-4b05-86e5-c932d4bc89b1" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "cinder-quobyte-acb8c27d-1357-4b05-86e5-c932d4bc89b1" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[77246734-00ed-4cd0-bcf2-2acbe1e6afba]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:08 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-94bd7473-e14f-4f03-9b43-7d91892a8b57" returned: 0 in 0.301s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Lock "cinder-quobyte-94bd7473-e14f-4f03-9b43-7d91892a8b57" released by "delete_volume" :: held 0.760s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Created reservations ['a68036ce-bfe2-4a8f-80d3-099c1278a8fa', 'b19b4127-0e2c-43c8-b70c-1584e6563dd2', '0d0323bd-fd86-46bf-a1c0-ad18595876a9', 'd182d201-75bc-42ef-8a3a-5be30b8441b6'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:09 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1 Jul 23 10:22:09 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:09 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:22:09 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Acquiring lock "cinder-981869f0-9e26-46aa-85a7-f2aef18c198f-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Lock "cinder-981869f0-9e26-46aa-85a7-f2aef18c198f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:09 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1" returned: 0 in 0.520s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:09 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1 Jul 23 10:22:09 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Acquiring lock "cinder-quobyte-981869f0-9e26-46aa-85a7-f2aef18c198f" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Lock "cinder-quobyte-981869f0-9e26-46aa-85a7-f2aef18c198f" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[558354c5-8f7d-4fe3-b1bf-00a5ba83b296]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:09 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.427s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:09 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Deleted volume successfully. Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8cd59f22-1c71-4f72-8a20-b616e6c45f55 tempest-AbsoluteLimitsTests-1910333430 None] Lock "cinder-94bd7473-e14f-4f03-9b43-7d91892a8b57-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:09 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f Jul 23 10:22:09 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:09 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-acb8c27d-1357-4b05-86e5-c932d4bc89b1" returned: 0 in 0.325s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "cinder-quobyte-acb8c27d-1357-4b05-86e5-c932d4bc89b1" released by "delete_volume" :: held 0.894s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Created reservations ['506aca8d-77fb-4cc2-b4af-8ba9a2f55245', 'f181d59e-332a-4ecc-ad02-f3583ba95255', '38305532-ea69-453f-92db-026a2941b757', '22584aeb-8ee4-4e00-8e78-c72bca88b9c3'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:09 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:22:09 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:10 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f" returned: 0 in 0.455s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:10 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f Jul 23 10:22:10 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:10 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.346s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:10 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Deleted volume successfully. Jul 23 10:22:10 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-981869f0-9e26-46aa-85a7-f2aef18c198f" returned: 0 in 0.304s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5d386412-1efe-4e07-840e-22c36d14bc39 tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "cinder-acb8c27d-1357-4b05-86e5-c932d4bc89b1-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Lock "cinder-quobyte-981869f0-9e26-46aa-85a7-f2aef18c198f" released by "delete_volume" :: held 0.825s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Created reservations ['7e3c577c-44c5-4d86-8923-d781eebbec41', 'c96bc446-1a71-4551-923f-669ecfa81e9b', '586a19e8-5a30-4780-b8e6-af9405d96985', '84190ec4-65ee-4104-9d89-cf8d3cbdf727'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:10 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:22:10 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Flow 'volume_create_manager' (3bc2de01-1f67-4238-92fe-d3d53cb15498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4884019d-e720-46d9-9637-27c9466d7aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4884019d-e720-46d9-9637-27c9466d7aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1053850762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a482203f-601d-4631-be35-a757f313a799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502452782fb74b21ad719fcdb3a9d816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:11Z,use_quota=True,user_id='5d5fc920dcce4ba89028334e3ac715f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0237ac-37dc-4200-99ad-d8b3b1794c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0237ac-37dc-4200-99ad-d8b3b1794c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352feac4-06d4-4509-9aca-61f0771b4ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352feac4-06d4-4509-9aca-61f0771b4ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a482203f-601d-4631-be35-a757f313a799', 'volume_name': 'volume-a482203f-601d-4631-be35-a757f313a799', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34204266-f269-4062-a378-17634d700fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34204266-f269-4062-a378-17634d700fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a9c98c-5569-4bef-b81f-d74742ff302d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:10 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Volume a482203f-601d-4631-be35-a757f313a799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a482203f-601d-4631-be35-a757f313a799', 'volume_size': 1} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1053850762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a482203f-601d-4631-be35-a757f313a799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502452782fb74b21ad719fcdb3a9d816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:11Z,use_quota=True,user_id='5d5fc920dcce4ba89028334e3ac715f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Creating volume a482203f-601d-4631-be35-a757f313a799 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:22:10 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:10 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799 1073741824 Jul 23 10:22:10 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:10 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.381s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:10 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Deleted volume successfully. Jul 23 10:22:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-92b292d7-b4de-4d02-9061-19010a62a6bf tempest-ServerActionsTestOtherA-466966482 None] Lock "cinder-981869f0-9e26-46aa-85a7-f2aef18c198f-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:11 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799 1073741824" returned: 0 in 0.683s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:11 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799 Jul 23 10:22:11 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:12 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799" returned: 0 in 0.484s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:22:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a9c98c-5569-4bef-b81f-d74742ff302d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a482203f-601d-4631-be35-a757f313a799', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887e13c3-b9d8-43ca-9f5a-d1ad6ede933e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:12 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Volume volume-a482203f-601d-4631-be35-a757f313a799 (a482203f-601d-4631-be35-a757f313a799): created successfully Jul 23 10:22:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887e13c3-b9d8-43ca-9f5a-d1ad6ede933e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Flow 'volume_create_manager' (3bc2de01-1f67-4238-92fe-d3d53cb15498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:12 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-bdd86b2d-ca96-412b-825b-80c15ca0d9ff tempest-VolumeQuotasAdminTestJSON-1879285766 None] Created volume successfully. Jul 23 10:22:13 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d8e970f4-2198-4fda-b10c-d2e03807ad99 tempest-VolumeQuotasAdminTestJSON-2088548238 None] Transfer volume completed successfully. Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Acquiring lock "cinder-a482203f-601d-4631-be35-a757f313a799-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Lock "cinder-a482203f-601d-4631-be35-a757f313a799-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Acquiring lock "cinder-quobyte-a482203f-601d-4631-be35-a757f313a799" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Lock "cinder-quobyte-a482203f-601d-4631-be35-a757f313a799" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0e3b59-b4d3-44e5-9d55-08f464a0073e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:14 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799 Jul 23 10:22:14 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Flow 'volume_create_manager' (d8057fca-18d4-4009-bd0a-8d882443b9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c35eea-3c23-4e65-a631-05b3faff9534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c35eea-3c23-4e65-a631-05b3faff9534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1983789031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86087af1-6ae2-493e-a5a0-2d5260ca1357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2710e1a8cf4f2e82356154df6bce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:15Z,use_quota=True,user_id='a127cf5f3e9d4c63a3c538b28a51665c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21460a0-4571-4c9f-87b6-2e9bd081c581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21460a0-4571-4c9f-87b6-2e9bd081c581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44d9753-0695-49cd-9dec-c823c8ccb8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44d9753-0695-49cd-9dec-c823c8ccb8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86087af1-6ae2-493e-a5a0-2d5260ca1357', 'volume_name': 'volume-86087af1-6ae2-493e-a5a0-2d5260ca1357', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcd3d92-f344-4dde-94d1-fb1b4678f36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcd3d92-f344-4dde-94d1-fb1b4678f36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78474fc-382c-4aa8-bf38-de1bde5abd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:14 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Volume 86087af1-6ae2-493e-a5a0-2d5260ca1357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86087af1-6ae2-493e-a5a0-2d5260ca1357', 'volume_size': 1} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1983789031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86087af1-6ae2-493e-a5a0-2d5260ca1357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2710e1a8cf4f2e82356154df6bce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:15Z,use_quota=True,user_id='a127cf5f3e9d4c63a3c538b28a51665c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Creating volume 86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:22:14 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:14 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799" returned: 0 in 0.408s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:14 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 1073741824 Jul 23 10:22:14 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:15 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799 Jul 23 10:22:15 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:15 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a482203f-601d-4631-be35-a757f313a799" returned: 0 in 0.260s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Lock "cinder-quobyte-a482203f-601d-4631-be35-a757f313a799" released by "delete_volume" :: held 0.712s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Created reservations ['a96fc9a8-165e-4eb0-bbda-4b888d50ff12', '477a605f-b824-4d94-b2cb-c0b18c872412', 'b2cde815-c15c-4743-931d-3bd6421166e9', '1ce98709-d7cf-4ae4-b727-eac6fac213c7'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:15 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:22:15 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:15 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 1073741824" returned: 0 in 0.518s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:15 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 Jul 23 10:22:15 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:15 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.453s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Deleted volume successfully. Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c5d64c2a-1495-434b-9ee7-97c64b23b0f3 tempest-VolumeQuotasAdminTestJSON-720703767 None] Lock "cinder-a482203f-601d-4631-be35-a757f313a799-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:15 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357" returned: 0 in 0.416s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78474fc-382c-4aa8-bf38-de1bde5abd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86087af1-6ae2-493e-a5a0-2d5260ca1357', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eec2a54-b99e-4894-a0e4-68ff93a5cf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:15 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Volume volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 (86087af1-6ae2-493e-a5a0-2d5260ca1357): created successfully Jul 23 10:22:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eec2a54-b99e-4894-a0e4-68ff93a5cf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Flow 'volume_create_manager' (d8057fca-18d4-4009-bd0a-8d882443b9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:16 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c14b3faa-b5b3-44ba-9745-9b291634326f tempest-VolumesDeleteCascade-1461431153 None] Created volume successfully. Jul 23 10:22:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] Creating offline snapshot 0b0e768f-525b-4041-b631-f6baa2c82e94 of volume 86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:22:17 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[418ff678-54a8-492f-b37c-99c335781cdc]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:17 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 Jul 23 10:22:17 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:17 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357" returned: 0 in 0.455s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:17 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 1G Jul 23 10:22:17 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:18 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 1G" returned: 0 in 0.585s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:18 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 Jul 23 10:22:18 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:18 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94" returned: 0 in 0.331s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:18 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 is being set with open permissions: ugo+rw Jul 23 10:22:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:18 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 Jul 23 10:22:18 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:19 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94" returned: 0 in 0.287s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:19 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.info Jul 23 10:22:19 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:19 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.info" returned: 0 in 0.312s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:19 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.info is being set with open permissions: ugo+rw Jul 23 10:22:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:19 devstack sudo[92200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.info Jul 23 10:22:19 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:19 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.info" returned: 0 in 0.326s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f82a54b2-01e6-4550-a968-82618e3b1571 tempest-VolumesDeleteCascade-1461431153 None] Create snapshot completed successfully Jul 23 10:22:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] Creating offline snapshot 3b78f527-7ba3-438b-80fb-fc56f2b14f2e of volume 86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:22:21 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c376ae-aac2-4782-8afc-f6cbb3d4ccd5]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:21 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 Jul 23 10:22:21 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:21 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94" returned: 0 in 0.621s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86087af1-6ae2-493e-a5a0-2d5260ca1357(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:22:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:21 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e 1G Jul 23 10:22:21 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:22 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e 1G" returned: 0 in 0.810s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:22 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e Jul 23 10:22:22 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:23 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e" returned: 0 in 0.559s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:23 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e is being set with open permissions: ugo+rw Jul 23 10:22:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:23 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e Jul 23 10:22:23 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-d7088b7a-5e9e-40bb-b051-562db0550c66 req-5f201c58-95ca-4822-8a86-a66cf48acb64 tempest-TaggedAttachmentsTest-848787705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:23 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e" returned: 0 in 0.495s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-d7088b7a-5e9e-40bb-b051-562db0550c66 req-5f201c58-95ca-4822-8a86-a66cf48acb64 tempest-TaggedAttachmentsTest-848787705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.076s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-d7088b7a-5e9e-40bb-b051-562db0550c66 req-5f201c58-95ca-4822-8a86-a66cf48acb64 tempest-TaggedAttachmentsTest-848787705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:23 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1af78b3b-2aa2-47d8-986d-d565046a1acd tempest-VolumesDeleteCascade-1461431153 None] Create snapshot completed successfully Jul 23 10:22:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-d7088b7a-5e9e-40bb-b051-562db0550c66 req-5f201c58-95ca-4822-8a86-a66cf48acb64 tempest-TaggedAttachmentsTest-848787705 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-192fa56b-3099-4808-be6e-d2f308cbfe69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4a6c210-dabe-4809-bc34-1fc392b7105f', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:22:23 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-d7088b7a-5e9e-40bb-b051-562db0550c66 req-5f201c58-95ca-4822-8a86-a66cf48acb64 tempest-TaggedAttachmentsTest-848787705 None] attachment_update completed successfully. Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-86087af1-6ae2-493e-a5a0-2d5260ca1357-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-86087af1-6ae2-493e-a5a0-2d5260ca1357-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Performing cascade delete. {{(pid=88371) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-0b0e768f-525b-4041-b631-f6baa2c82e94-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-0b0e768f-525b-4041-b631-f6baa2c82e94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-quobyte-86087af1-6ae2-493e-a5a0-2d5260ca1357" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-86087af1-6ae2-493e-a5a0-2d5260ca1357" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-quobyte-0b0e768f-525b-4041-b631-f6baa2c82e94" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-0b0e768f-525b-4041-b631-f6baa2c82e94" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Deleting offline snapshot 0b0e768f-525b-4041-b631-f6baa2c82e94 of volume 86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] snapshot_file for this snap is: volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a60095-c40a-48e5-aa73-91181406f680]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:24 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 Jul 23 10:22:24 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:25 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94" returned: 0 in 0.671s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86087af1-6ae2-493e-a5a0-2d5260ca1357(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:22:25 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70f903b-d5f2-4ae7-9ef4-9a1df75682c3]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:25 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 Jul 23 10:22:25 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:25 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357" returned: 0 in 0.511s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:25 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d765058-eed0-4bc8-95fc-f95bb5318691]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:25 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e Jul 23 10:22:25 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:26 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e" returned: 0 in 0.532s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86087af1-6ae2-493e-a5a0-2d5260ca1357(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbd5a26-213a-4281-a51c-d82fd27cf6c0]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:26 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 Jul 23 10:22:26 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Flow 'volume_create_manager' (35345aa0-11e8-4fae-927b-54066b588b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a81935-73d0-459c-a47e-fac82522a7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a81935-73d0-459c-a47e-fac82522a7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1692179843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030cdaad-4533-4f76-9134-1706937b1358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='333a91d4f8714663ba8ddaeb091b2bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:27Z,use_quota=True,user_id='33cb43c860d34a2e9c759f11291b2f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fd6d4ce-748b-44df-af19-9623e023b7d1),volume_type_id=2fd6d4ce-748b-44df-af19-9623e023b7d1)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a02ae51-1368-4711-bed3-7a3c2181bcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a02ae51-1368-4711-bed3-7a3c2181bcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6304710-9d7e-445e-b89e-896affcddd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6304710-9d7e-445e-b89e-896affcddd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030cdaad-4533-4f76-9134-1706937b1358', 'volume_name': 'volume-030cdaad-4533-4f76-9134-1706937b1358', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cb4c70-dc79-4642-81bf-10df8080c640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cb4c70-dc79-4642-81bf-10df8080c640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f23b6d-242f-47e0-bd84-9a51ead6f4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:26 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Volume 030cdaad-4533-4f76-9134-1706937b1358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030cdaad-4533-4f76-9134-1706937b1358', 'volume_size': 1} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1692179843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030cdaad-4533-4f76-9134-1706937b1358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='333a91d4f8714663ba8ddaeb091b2bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:27Z,use_quota=True,user_id='33cb43c860d34a2e9c759f11291b2f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fd6d4ce-748b-44df-af19-9623e023b7d1),volume_type_id=2fd6d4ce-748b-44df-af19-9623e023b7d1)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Creating volume 030cdaad-4533-4f76-9134-1706937b1358 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:26 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:22:26 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94" returned: 0 in 0.565s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86087af1-6ae2-493e-a5a0-2d5260ca1357(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd49194-052e-438b-bc1b-12727d3f6918]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:26 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358 1073741824 Jul 23 10:22:26 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:27 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 Jul 23 10:22:27 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:27 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-79f19b27-0a92-43ef-b9d0-724df1122f97 req-d9f68d70-cf54-424e-9568-0d5368760237 tempest-TaggedAttachmentsTest-848787705 None] Terminate volume connection completed successfully. Jul 23 10:22:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-79f19b27-0a92-43ef-b9d0-724df1122f97 req-d9f68d70-cf54-424e-9568-0d5368760237 tempest-TaggedAttachmentsTest-848787705 None] Deleting attachment e4a6c210-dabe-4809-bc34-1fc392b7105f. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:22:27 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357" returned: 0 in 0.463s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:27 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 Jul 23 10:22:27 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:27 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358 1073741824" returned: 0 in 0.611s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:27 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358 Jul 23 10:22:27 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:27 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94" returned: 0 in 0.476s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:27 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94 Jul 23 10:22:27 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:28 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358" returned: 0 in 0.505s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f23b6d-242f-47e0-bd84-9a51ead6f4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030cdaad-4533-4f76-9134-1706937b1358', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7411af9d-3097-4c6e-aeeb-a221909cf65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:28 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Volume volume-030cdaad-4533-4f76-9134-1706937b1358 (030cdaad-4533-4f76-9134-1706937b1358): created successfully Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7411af9d-3097-4c6e-aeeb-a221909cf65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Flow 'volume_create_manager' (35345aa0-11e8-4fae-927b-54066b588b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:28 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-688f8465-88c3-4207-95df-984ce3419fff tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Created volume successfully. Jul 23 10:22:28 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.0b0e768f-525b-4041-b631-f6baa2c82e94" returned: 0 in 0.323s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e -F qcow2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:28 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e -F qcow2 Jul 23 10:22:28 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:28 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e -F qcow2" returned: 0 in 0.517s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-0b0e768f-525b-4041-b631-f6baa2c82e94" released by "_delete_snapshot" :: held 4.315s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-86087af1-6ae2-493e-a5a0-2d5260ca1357" released by "delete_snapshot" :: held 4.360s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:28 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Created reservations ['bb7fd180-ce92-4433-b0ba-58cff7fc6858', 'd68e752d-66cb-4225-898e-93971527139f', '64898fb8-84d7-4c04-b6b3-3d1a2f45757e', '2b4f5565-6272-41c8-9f58-73685a67b488'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:29 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Delete snapshot completed successfully. Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-0b0e768f-525b-4041-b631-f6baa2c82e94-delete_snapshot" released by "delete_snapshot" :: held 4.623s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-3b78f527-7ba3-438b-80fb-fc56f2b14f2e-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-3b78f527-7ba3-438b-80fb-fc56f2b14f2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-quobyte-86087af1-6ae2-493e-a5a0-2d5260ca1357" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-86087af1-6ae2-493e-a5a0-2d5260ca1357" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-quobyte-3b78f527-7ba3-438b-80fb-fc56f2b14f2e" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-3b78f527-7ba3-438b-80fb-fc56f2b14f2e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Deleting offline snapshot 3b78f527-7ba3-438b-80fb-fc56f2b14f2e of volume 86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] snapshot_file for this snap is: volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2d0fdc-5998-4a54-9fa3-90774caf9ec8]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:29 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e Jul 23 10:22:29 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-260fd15e-0af8-4f2a-8c2b-4e04f918eef2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-260fd15e-0af8-4f2a-8c2b-4e04f918eef2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-260fd15e-0af8-4f2a-8c2b-4e04f918eef2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-260fd15e-0af8-4f2a-8c2b-4e04f918eef2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-260fd15e-0af8-4f2a-8c2b-4e04f918eef2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-260fd15e-0af8-4f2a-8c2b-4e04f918eef2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:29 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:22:29 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:29 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e" returned: 0 in 0.626s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86087af1-6ae2-493e-a5a0-2d5260ca1357(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af90519-06c8-4ae6-8de0-b74a4e0eef0c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:30 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-260fd15e-0af8-4f2a-8c2b-4e04f918eef2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.313s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:30 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-260fd15e-0af8-4f2a-8c2b-4e04f918eef2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:30 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-260fd15e-0af8-4f2a-8c2b-4e04f918eef2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Retype volume completed successfully. Jul 23 10:22:30 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 Jul 23 10:22:30 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:30 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357" returned: 0 in 0.478s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:30 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e Jul 23 10:22:30 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:30 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e" returned: 0 in 0.341s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:30 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e Jul 23 10:22:30 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Acquiring lock "cinder-030cdaad-4533-4f76-9134-1706937b1358-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "cinder-030cdaad-4533-4f76-9134-1706937b1358-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Acquiring lock "cinder-quobyte-030cdaad-4533-4f76-9134-1706937b1358" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:31 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357.3b78f527-7ba3-438b-80fb-fc56f2b14f2e" returned: 0 in 0.366s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "cinder-quobyte-030cdaad-4533-4f76-9134-1706937b1358" acquired by "delete_volume" :: waited 0.063s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-3b78f527-7ba3-438b-80fb-fc56f2b14f2e" released by "_delete_snapshot" :: held 2.009s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-86087af1-6ae2-493e-a5a0-2d5260ca1357" released by "delete_snapshot" :: held 2.043s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[815be661-5155-40de-af21-6cdcc337c9d8]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Created reservations ['bc7a16c5-49ac-4b0d-8927-a2f1d61f44e9', '44cf6e5a-0f7e-440c-80b5-20c1a727ca16', '11cb8e1c-667d-4804-8860-3afd1757dda8', '2da13073-eaf2-4918-99ec-8515231c5f77'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:31 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Delete snapshot completed successfully. Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-3b78f527-7ba3-438b-80fb-fc56f2b14f2e-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Snapshots deleted, issuing volume delete {{(pid=88371) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-quobyte-86087af1-6ae2-493e-a5a0-2d5260ca1357" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:31 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358 Jul 23 10:22:31 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-86087af1-6ae2-493e-a5a0-2d5260ca1357" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b69dc3-4293-45cc-afb5-9d91887d0770]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:31 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 Jul 23 10:22:31 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:31 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358" returned: 0 in 0.473s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:31 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358 Jul 23 10:22:31 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:31 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357" returned: 0 in 0.400s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:31 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357 Jul 23 10:22:31 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:32 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-030cdaad-4533-4f76-9134-1706937b1358" returned: 0 in 0.376s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "cinder-quobyte-030cdaad-4533-4f76-9134-1706937b1358" released by "delete_volume" :: held 0.921s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:32 devstack cinder-volume[88371]: WARNING cinder.quota [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:22:32 devstack cinder-volume[88371]: WARNING cinder.quota [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Created reservations ['b2c2ed61-8094-408f-b55b-bcf93980d5df', '44905bfd-d795-42a1-a62c-540895cf75d1', '2eb4160e-e5fb-43dc-844b-586e0c500e27', '88bc6a50-7438-43b0-973e-2b9b633bd76e'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:32 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-86087af1-6ae2-493e-a5a0-2d5260ca1357" returned: 0 in 0.308s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-86087af1-6ae2-493e-a5a0-2d5260ca1357" released by "delete_volume" :: held 0.799s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Created reservations ['0787b100-e442-4893-aab0-165b74d033d7', 'a790e22f-62d8-4ef6-85fe-67b55168ec9b', '860ce88b-60fb-43fa-9cc6-f99d21aa2307', '994c0190-6e4c-41cd-94fd-f5a2fe86be5d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:32 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:22:32 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:32 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:22:32 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:32 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:32 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.423s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.504s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:32 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Deleted volume successfully. Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6469ead1-f64e-4d42-891a-06805e4739b0 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-86087af1-6ae2-493e-a5a0-2d5260ca1357-delete_volume" released by "delete_volume" :: held 8.563s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:32 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Deleted volume successfully. Jul 23 10:22:32 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ec44225-f400-4b28-badd-d771826fc8d2 tempest-VolumeRetypeWithoutMigrationTest-14469943 None] Lock "cinder-030cdaad-4533-4f76-9134-1706937b1358-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Flow 'volume_create_manager' (5bb043e5-f3d7-4dea-b402-adcdeb23ffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06afd62f-11a1-4bc0-b13a-9a70383f1a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06afd62f-11a1-4bc0-b13a-9a70383f1a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-447604338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69c9864-c7cc-49b3-a615-56cc67a577c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2710e1a8cf4f2e82356154df6bce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:34Z,use_quota=True,user_id='a127cf5f3e9d4c63a3c538b28a51665c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad27a115-0266-40e3-8156-871a59bcce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad27a115-0266-40e3-8156-871a59bcce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2534553b-646b-4f1c-84db-f530d7a726ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2534553b-646b-4f1c-84db-f530d7a726ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e69c9864-c7cc-49b3-a615-56cc67a577c4', 'volume_name': 'volume-e69c9864-c7cc-49b3-a615-56cc67a577c4', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c5a713-0c75-4ab0-8f6c-401c28b74da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c5a713-0c75-4ab0-8f6c-401c28b74da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c192e1c1-f406-4023-82fe-c4bfcdacdbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:34 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Volume e69c9864-c7cc-49b3-a615-56cc67a577c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e69c9864-c7cc-49b3-a615-56cc67a577c4', 'volume_size': 1} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-447604338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69c9864-c7cc-49b3-a615-56cc67a577c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2710e1a8cf4f2e82356154df6bce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:34Z,use_quota=True,user_id='a127cf5f3e9d4c63a3c538b28a51665c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Creating volume e69c9864-c7cc-49b3-a615-56cc67a577c4 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:22:34 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:22:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:34 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 1073741824 Jul 23 10:22:34 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:35 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 1073741824" returned: 0 in 0.549s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:35 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 Jul 23 10:22:35 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:35 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4" returned: 0 in 0.442s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:22:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c192e1c1-f406-4023-82fe-c4bfcdacdbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e69c9864-c7cc-49b3-a615-56cc67a577c4', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86db1e50-b9ad-4881-bb15-1f8be3c2cd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:35 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Volume volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 (e69c9864-c7cc-49b3-a615-56cc67a577c4): created successfully Jul 23 10:22:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86db1e50-b9ad-4881-bb15-1f8be3c2cd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Flow 'volume_create_manager' (5bb043e5-f3d7-4dea-b402-adcdeb23ffdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:35 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-82f56de8-2d6f-4df0-a1d6-9fe78451bc4e tempest-VolumesDeleteCascade-1461431153 None] Created volume successfully. Jul 23 10:22:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] Creating offline snapshot 7e5475a5-07dc-49f8-b8a3-9458d6c17b54 of volume e69c9864-c7cc-49b3-a615-56cc67a577c4 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:22:36 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4455b1bb-5f7e-4a70-aba3-851e817ce316]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:36 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 Jul 23 10:22:36 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:37 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4" returned: 0 in 0.435s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:37 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 1G Jul 23 10:22:37 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:37 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 1G" returned: 0 in 0.588s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:37 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 Jul 23 10:22:37 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:38 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54" returned: 0 in 0.377s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:38 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 is being set with open permissions: ugo+rw Jul 23 10:22:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:38 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 Jul 23 10:22:38 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:38 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54" returned: 0 in 0.349s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:38 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.info Jul 23 10:22:38 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:38 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.info" returned: 0 in 0.375s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:38 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.info is being set with open permissions: ugo+rw Jul 23 10:22:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:39 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.info Jul 23 10:22:39 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:39 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.info" returned: 0 in 0.382s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:39 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4e3568ef-daab-44d4-9651-db1cb43b34b2 tempest-VolumesDeleteCascade-1461431153 None] Create snapshot completed successfully Jul 23 10:22:40 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:22:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Flow 'volume_create_manager' (9c9edbdc-1188-45b5-ad98-058530cc1e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44d61c2-6981-4746-8f8d-1f7cfeb66e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44d61c2-6981-4746-8f8d-1f7cfeb66e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-81123069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ac8516-2e5f-4c4a-8f84-c364ac9d25b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2710e1a8cf4f2e82356154df6bce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e5475a5-07dc-49f8-b8a3-9458d6c17b54,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:41Z,use_quota=True,user_id='a127cf5f3e9d4c63a3c538b28a51665c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4b7566-dde6-4c16-b1c2-14d390999a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4b7566-dde6-4c16-b1c2-14d390999a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa09c3f-5b39-4b23-bbf4-bbcea0bd3242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa09c3f-5b39-4b23-bbf4-bbcea0bd3242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '29ac8516-2e5f-4c4a-8f84-c364ac9d25b7', 'volume_name': 'volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7', 'volume_size': 1, 'snapshot_id': '7e5475a5-07dc-49f8-b8a3-9458d6c17b54'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae62b788-97b0-4d99-abde-c3e4068e1d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae62b788-97b0-4d99-abde-c3e4068e1d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942aee41-b904-4a6f-b80d-30e448e17258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:41 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Volume 29ac8516-2e5f-4c4a-8f84-c364ac9d25b7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7', 'volume_size': 1, 'snapshot_id': '7e5475a5-07dc-49f8-b8a3-9458d6c17b54'} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-quobyte-7e5475a5-07dc-49f8-b8a3-9458d6c17b54-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" by "_create_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Acquiring lock "cinder-192fa56b-3099-4808-be6e-d2f308cbfe69-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Lock "cinder-192fa56b-3099-4808-be6e-d2f308cbfe69-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-7e5475a5-07dc-49f8-b8a3-9458d6c17b54-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Creating volume 29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 from snapshot 7e5475a5-07dc-49f8-b8a3-9458d6c17b54 {{(pid=88371) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-quobyte-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] snapshot: 7e5475a5-07dc-49f8-b8a3-9458d6c17b54, volume: 29ac8516-2e5f-4c4a-8f84-c364ac9d25b7, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Acquiring lock "cinder-quobyte-192fa56b-3099-4808-be6e-d2f308cbfe69" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e68f74e-23d7-4c07-9237-354ec3f7639e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Lock "cinder-quobyte-192fa56b-3099-4808-be6e-d2f308cbfe69" acquired by "delete_volume" :: waited 0.037s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f27e55-9742-4e24-a82a-96b6c2133319]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:41 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 Jul 23 10:22:41 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:41 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69 Jul 23 10:22:41 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:41 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69" returned: 0 in 0.519s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:41 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54" returned: 0 in 0.605s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69c9864-c7cc-49b3-a615-56cc67a577c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb4c84b-751a-4d0a-a857-e27b56bfa5af]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:41 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69 Jul 23 10:22:41 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:42 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 Jul 23 10:22:42 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:42 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-192fa56b-3099-4808-be6e-d2f308cbfe69" returned: 0 in 0.316s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Lock "cinder-quobyte-192fa56b-3099-4808-be6e-d2f308cbfe69" released by "delete_volume" :: held 0.906s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Created reservations ['12e4c27d-5944-412c-91a5-e75e2ec496fb', '608fd36d-26cb-488a-910a-d9b1dd565dbd', '2437ac1c-8a83-4a69-bf66-56ef3705522f', '1a7ed66b-effd-4e7c-b38a-951ecfeb44aa'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:42 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:22:42 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:42 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4" returned: 0 in 0.579s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:42 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 Jul 23 10:22:42 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:42 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.503s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:42 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Deleted volume successfully. Jul 23 10:22:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a2158272-d00c-4204-aeed-415750a81727 tempest-TaggedAttachmentsTest-848787705 None] Lock "cinder-192fa56b-3099-4808-be6e-d2f308cbfe69-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Flow 'volume_create_manager' (42edb209-3612-4f19-b2d1-6102dd64e0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6573f587-3072-4c7a-abf1-44653fa3811f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6573f587-3072-4c7a-abf1-44653fa3811f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-884844888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a993fe51-7d83-489a-9c1b-b956a0788651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee01e087d993456fa581428cef21e832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:45Z,use_quota=True,user_id='a98b7695d34f4c58b9706b5ca4570009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2648cce1-f0b3-44ce-a8e8-601832a77732),volume_type_id=2648cce1-f0b3-44ce-a8e8-601832a77732)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf171311-4f57-4746-a3ee-2e7bc0d8c05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf171311-4f57-4746-a3ee-2e7bc0d8c05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12528bc-6886-4f34-9d2a-85ecb8c873ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12528bc-6886-4f34-9d2a-85ecb8c873ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a993fe51-7d83-489a-9c1b-b956a0788651', 'volume_name': 'volume-a993fe51-7d83-489a-9c1b-b956a0788651', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06474adf-b45b-4e92-b06e-a5def21a28af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06474adf-b45b-4e92-b06e-a5def21a28af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5631353-2281-4ed8-b2d2-4b0e6634b9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:45 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Volume a993fe51-7d83-489a-9c1b-b956a0788651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a993fe51-7d83-489a-9c1b-b956a0788651', 'volume_size': 1} Jul 23 10:22:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:22:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:46 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:22:46 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:47 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.777s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:47 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:47 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:22:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 9 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:22:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:22:49 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" returned: 0 in 7.016s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:49 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[469a1bb7-7769-46d2-ae4c-aa26cf379fc8]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:49 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 Jul 23 10:22:49 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:50 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4" returned: 0 in 0.646s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:22:50 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Converted 1024.00 MB image at 145.94 MB/s Jul 23 10:22:50 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 is being set with open permissions: ugo+rw Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:50 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 Jul 23 10:22:50 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:50 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" returned: 0 in 0.282s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" released by "_copy_volume_from_snapshot" :: held 9.280s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-7e5475a5-07dc-49f8-b8a3-9458d6c17b54-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" released by "_create_volume_from_snapshot" :: held 9.335s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.387s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.916s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-884844888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a993fe51-7d83-489a-9c1b-b956a0788651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee01e087d993456fa581428cef21e832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:22:45Z,use_quota=True,user_id='a98b7695d34f4c58b9706b5ca4570009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2648cce1-f0b3-44ce-a8e8-601832a77732),volume_type_id=2648cce1-f0b3-44ce-a8e8-601832a77732)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Creating volume a993fe51-7d83-489a-9c1b-b956a0788651 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:22:50 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:50 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651 1073741824 Jul 23 10:22:50 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942aee41-b904-4a6f-b80d-30e448e17258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7', 'volume_size': 1, 'snapshot_id': '7e5475a5-07dc-49f8-b8a3-9458d6c17b54'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20556710-a512-4d8b-9be3-31223ab51129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:50 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Volume volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 (29ac8516-2e5f-4c4a-8f84-c364ac9d25b7): created successfully Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20556710-a512-4d8b-9be3-31223ab51129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Flow 'volume_create_manager' (9c9edbdc-1188-45b5-ad98-058530cc1e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:50 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-02810f29-be01-4433-b4b8-e731811386a1 tempest-VolumesDeleteCascade-1461431153 None] Created volume successfully. Jul 23 10:22:51 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651 1073741824" returned: 0 in 0.615s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:51 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651 Jul 23 10:22:51 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-e69c9864-c7cc-49b3-a615-56cc67a577c4-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-e69c9864-c7cc-49b3-a615-56cc67a577c4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Performing cascade delete. {{(pid=88371) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-7e5475a5-07dc-49f8-b8a3-9458d6c17b54-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-7e5475a5-07dc-49f8-b8a3-9458d6c17b54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-quobyte-e69c9864-c7cc-49b3-a615-56cc67a577c4" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:51 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651" returned: 0 in 0.426s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-e69c9864-c7cc-49b3-a615-56cc67a577c4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-quobyte-7e5475a5-07dc-49f8-b8a3-9458d6c17b54" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5631353-2281-4ed8-b2d2-4b0e6634b9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a993fe51-7d83-489a-9c1b-b956a0788651', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b911e1f-ac3c-4fc9-b14a-4a4a1dbc9beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-7e5475a5-07dc-49f8-b8a3-9458d6c17b54" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Deleting offline snapshot 7e5475a5-07dc-49f8-b8a3-9458d6c17b54 of volume e69c9864-c7cc-49b3-a615-56cc67a577c4 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] snapshot_file for this snap is: volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d15b5ea-202b-4014-9794-daa1e6359135]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:51 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Volume volume-a993fe51-7d83-489a-9c1b-b956a0788651 (a993fe51-7d83-489a-9c1b-b956a0788651): created successfully Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b911e1f-ac3c-4fc9-b14a-4a4a1dbc9beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:22:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Flow 'volume_create_manager' (42edb209-3612-4f19-b2d1-6102dd64e0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:22:51 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-72d0fcdf-1da0-4877-b725-93d7776ec8be tempest-VolumeTypesAccessTest-283993704 None] Created volume successfully. Jul 23 10:22:51 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 Jul 23 10:22:51 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:52 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54" returned: 0 in 0.613s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69c9864-c7cc-49b3-a615-56cc67a577c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:22:52 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[0775db11-fa47-479e-ba1c-66937c1e6efb]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Acquiring lock "cinder-a993fe51-7d83-489a-9c1b-b956a0788651-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Lock "cinder-a993fe51-7d83-489a-9c1b-b956a0788651-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:52 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 Jul 23 10:22:52 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Acquiring lock "cinder-quobyte-a993fe51-7d83-489a-9c1b-b956a0788651" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Lock "cinder-quobyte-a993fe51-7d83-489a-9c1b-b956a0788651" acquired by "delete_volume" :: waited 0.058s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:52 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c1fcae-f0f2-468b-a426-20e4477804e3]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:53 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651 Jul 23 10:22:53 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:53 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4" returned: 0 in 0.933s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:53 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 Jul 23 10:22:53 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:53 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651" returned: 0 in 0.858s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:53 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651 Jul 23 10:22:53 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:54 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a993fe51-7d83-489a-9c1b-b956a0788651" returned: 0 in 0.529s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Lock "cinder-quobyte-a993fe51-7d83-489a-9c1b-b956a0788651" released by "delete_volume" :: held 1.477s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:54 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54" returned: 0 in 1.036s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:54 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54 Jul 23 10:22:54 devstack cinder-volume[88371]: WARNING cinder.quota [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-773111390 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-773111390, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:22:54 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:54 devstack cinder-volume[88371]: WARNING cinder.quota [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-773111390 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-773111390, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Created reservations ['1381785d-7433-45ac-86a4-13f4dcab1f3e', '3d532221-b83c-4f99-a6ea-5d29b026c66b', '724fc4e0-1636-4f71-aa52-eacdf6558910', 'ded0e882-24e8-4062-b65f-0ba2f884def6'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:54 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:22:54 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:54 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.325s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:54 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Deleted volume successfully. Jul 23 10:22:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d4ddf6ab-532d-4593-b7c1-1fa515fd3f3c tempest-VolumeTypesAccessTest-283993704 None] Lock "cinder-a993fe51-7d83-489a-9c1b-b956a0788651-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:55 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4.7e5475a5-07dc-49f8-b8a3-9458d6c17b54" returned: 0 in 0.776s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-7e5475a5-07dc-49f8-b8a3-9458d6c17b54" released by "_delete_snapshot" :: held 3.531s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-e69c9864-c7cc-49b3-a615-56cc67a577c4" released by "delete_snapshot" :: held 3.577s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:55 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Created reservations ['7b6ce030-6724-4cf0-a095-088438017404', '0ba6d6ac-d7b4-4eae-8647-7f767070c443', 'de6d3f63-7e6b-4bca-ad62-1eb760710f39', '73522844-de0c-4b5a-bd47-4038ab8eb89f'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Delete snapshot completed successfully. Jul 23 10:22:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-7e5475a5-07dc-49f8-b8a3-9458d6c17b54-delete_snapshot" released by "delete_snapshot" :: held 4.021s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Snapshots deleted, issuing volume delete {{(pid=88371) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 23 10:22:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-quobyte-e69c9864-c7cc-49b3-a615-56cc67a577c4" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-e69c9864-c7cc-49b3-a615-56cc67a577c4" acquired by "delete_volume" :: waited 0.046s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:55 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfca4d6a-df78-4650-9f38-8a7a6fb46b66]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:55 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 Jul 23 10:22:55 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:56 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4" returned: 0 in 1.005s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:56 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4 Jul 23 10:22:56 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:57 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e69c9864-c7cc-49b3-a615-56cc67a577c4" returned: 0 in 0.641s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-e69c9864-c7cc-49b3-a615-56cc67a577c4" released by "delete_volume" :: held 1.859s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:57 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Created reservations ['b213f888-6500-4566-a02e-7b160b711252', '91e105a4-0ad3-4dce-823e-564b852af0a5', '794a7f21-fbef-443f-b49c-23b8db1b12ce', 'ab2011ea-7791-4b7c-8058-2df0e3fb3036'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:22:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:22:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:22:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:22:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:22:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:22:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:57 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:22:57 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:58 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.605s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:58 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:22:58 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Deleted volume successfully. Jul 23 10:22:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-12169bd4-b640-432b-aa05-6c5935d99181 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-e69c9864-c7cc-49b3-a615-56cc67a577c4-delete_volume" released by "delete_volume" :: held 7.174s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:22:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "cinder-quobyte-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:22:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:22:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d60efc-2e47-4478-bf86-09a3d503d17e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:22:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:59 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 Jul 23 10:22:59 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:22:59 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Jul 23 10:22:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" returned: 0 in 0.615s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:22:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:22:59 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7 Jul 23 10:22:59 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:00 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" returned: 0 in 0.502s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-quobyte-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7" released by "delete_volume" :: held 1.206s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:23:00 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Created reservations ['06be0531-7347-4561-ad45-1a798b6301ab', 'ce3b4156-e72d-40c8-9d4e-3d1a7e9a254d', 'e499a49e-65f7-4a2d-8010-03cd28db7895', '3c15e065-3817-4d36-b1bd-ad599a906a9d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:23:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:00 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:23:00 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:01 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.490s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:01 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:23:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Deleted volume successfully. Jul 23 10:23:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d1e3f018-dc6b-4e5d-acd1-4f46709fe195 tempest-VolumesDeleteCascade-1461431153 None] Lock "cinder-29ac8516-2e5f-4c4a-8f84-c364ac9d25b7-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:23:10 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=125,cinder:SELECT=111,cinder:INSERT=32,cinder:DELETE=9 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:23:11 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=134,cinder:DELETE=12,cinder:INSERT=29,cinder:SELECT=100 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Flow 'volume_create_manager' (d65778e5-1346-4cf0-8094-7e439776bd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242cfe01-a01a-43c7-809b-1605bfff89c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242cfe01-a01a-43c7-809b-1605bfff89c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-973023599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1913e94a-a0a2-4b40-8288-4a9e70732473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6128bffb32ec4019a59281c4ee0c09d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:15Z,use_quota=True,user_id='8ddf1e8f64b0488d92c902d33aa9cb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d46a43b-d40c-434f-9a50-4988dfbb2a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d46a43b-d40c-434f-9a50-4988dfbb2a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e205bb-5b84-4678-ae2f-b996d567c9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e205bb-5b84-4678-ae2f-b996d567c9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1913e94a-a0a2-4b40-8288-4a9e70732473', 'volume_name': 'volume-1913e94a-a0a2-4b40-8288-4a9e70732473', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d3c30c-17a0-4ae5-8f23-21317ee99f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d3c30c-17a0-4ae5-8f23-21317ee99f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01197e2-c67a-435a-a1cf-becedecf3c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:14 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Volume 1913e94a-a0a2-4b40-8288-4a9e70732473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1913e94a-a0a2-4b40-8288-4a9e70732473', 'volume_size': 1} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-973023599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1913e94a-a0a2-4b40-8288-4a9e70732473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6128bffb32ec4019a59281c4ee0c09d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:15Z,use_quota=True,user_id='8ddf1e8f64b0488d92c902d33aa9cb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Creating volume 1913e94a-a0a2-4b40-8288-4a9e70732473 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:23:14 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:23:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:14 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473 1073741824 Jul 23 10:23:14 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:15 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473 1073741824" returned: 0 in 0.541s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:15 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473 Jul 23 10:23:15 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:15 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473" returned: 0 in 0.388s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:23:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01197e2-c67a-435a-a1cf-becedecf3c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1913e94a-a0a2-4b40-8288-4a9e70732473', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ceab140-4014-4fb1-a136-6f036faed161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:15 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Volume volume-1913e94a-a0a2-4b40-8288-4a9e70732473 (1913e94a-a0a2-4b40-8288-4a9e70732473): created successfully Jul 23 10:23:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ceab140-4014-4fb1-a136-6f036faed161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Flow 'volume_create_manager' (d65778e5-1346-4cf0-8094-7e439776bd68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:16 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-08aa11cb-8307-4089-a01e-21f085fac2e2 tempest-VolumesMetadataTest-1387196052 None] Created volume successfully. Jul 23 10:23:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Acquiring lock "cinder-1913e94a-a0a2-4b40-8288-4a9e70732473-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:23:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Lock "cinder-1913e94a-a0a2-4b40-8288-4a9e70732473-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:23:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Acquiring lock "cinder-quobyte-1913e94a-a0a2-4b40-8288-4a9e70732473" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:23:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Lock "cinder-quobyte-1913e94a-a0a2-4b40-8288-4a9e70732473" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:23:18 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[747b21d0-7433-49ec-ac35-a2388e37d2a4]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:23:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:18 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473 Jul 23 10:23:18 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:18 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473" returned: 0 in 0.402s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:18 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473 Jul 23 10:23:18 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:18 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1913e94a-a0a2-4b40-8288-4a9e70732473" returned: 0 in 0.304s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Lock "cinder-quobyte-1913e94a-a0a2-4b40-8288-4a9e70732473" released by "delete_volume" :: held 0.754s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:23:18 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Created reservations ['5a6bb4b5-baee-4116-b808-126100d5202b', 'f9d9c014-241e-43cb-98c8-9e59423185d6', '94136db6-59b1-414b-b2ca-7c6c9baf84ad', 'cbaa9dc9-f23d-494e-a312-585b5c29ded4'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:23:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:19 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:23:19 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:19 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.401s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:19 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:23:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Deleted volume successfully. Jul 23 10:23:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b55a65c6-6033-4e64-ba72-5c3dd15a6b31 tempest-VolumesMetadataTest-1387196052 None] Lock "cinder-1913e94a-a0a2-4b40-8288-4a9e70732473-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Flow 'volume_create_manager' (89bc6501-cac7-4f0c-aad6-3f827b627b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e752498-0b92-4f34-8617-e53d9019f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e752498-0b92-4f34-8617-e53d9019f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1043910078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc37b1a8-d043-4338-a46f-ce6140ce62b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20c3b5f659742d1addebd60ef328c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:24Z,use_quota=True,user_id='ec3968505e5b4c1fae4f5fb672468ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6644db79-976c-4f68-84eb-3a5bd1e486e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6644db79-976c-4f68-84eb-3a5bd1e486e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ee7100-fc10-4524-86f0-68ebf48c4bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ee7100-fc10-4524-86f0-68ebf48c4bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc37b1a8-d043-4338-a46f-ce6140ce62b6', 'volume_name': 'volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784712cc-e8a8-4a9b-92f4-8a81ea310860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784712cc-e8a8-4a9b-92f4-8a81ea310860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4d6f00-3635-4289-b02e-cff0881f2263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:23 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Volume dc37b1a8-d043-4338-a46f-ce6140ce62b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6', 'volume_size': 1} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1043910078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc37b1a8-d043-4338-a46f-ce6140ce62b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20c3b5f659742d1addebd60ef328c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:24Z,use_quota=True,user_id='ec3968505e5b4c1fae4f5fb672468ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Creating volume dc37b1a8-d043-4338-a46f-ce6140ce62b6 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:23 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:23:24 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:23:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:24 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6 1073741824 Jul 23 10:23:24 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:24 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6 1073741824" returned: 0 in 0.779s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:24 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6 Jul 23 10:23:24 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:25 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6" returned: 0 in 0.345s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:23:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:25 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4d6f00-3635-4289-b02e-cff0881f2263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:25 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0209a7-56dc-4c5b-bb20-be6dc9b2da57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:25 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Volume volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6 (dc37b1a8-d043-4338-a46f-ce6140ce62b6): created successfully Jul 23 10:23:25 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0209a7-56dc-4c5b-bb20-be6dc9b2da57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:25 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Flow 'volume_create_manager' (89bc6501-cac7-4f0c-aad6-3f827b627b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:25 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6798c260-9cea-4f8f-bd11-b3594d318500 tempest-ServerRescueNegativeTestJSON-428956319 None] Created volume successfully. Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Flow 'volume_create_manager' (31cbcc0a-ee15-4880-afa1-9af592f9c4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483544d3-7b75-42f7-aac6-f4ec8df1fb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483544d3-7b75-42f7-aac6-f4ec8df1fb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-610258537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50feba5f-3176-42e1-ba63-690ccb66dab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099f1662be394f569df84d2cb13ceb96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:30Z,use_quota=True,user_id='7f32fdfd11a543ff9dee9cbee1038a81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0374e4f6-5d41-4a0f-bc24-48edef3ff0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0374e4f6-5d41-4a0f-bc24-48edef3ff0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cc7107-3dc5-4651-8fc2-177fec6d679b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cc7107-3dc5-4651-8fc2-177fec6d679b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50feba5f-3176-42e1-ba63-690ccb66dab3', 'volume_name': 'volume-50feba5f-3176-42e1-ba63-690ccb66dab3', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe2515b-4eaf-40ac-99f4-8d85fe065a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe2515b-4eaf-40ac-99f4-8d85fe065a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f40efde-463a-4091-b106-1c1a3ccbdd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:29 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Volume 50feba5f-3176-42e1-ba63-690ccb66dab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50feba5f-3176-42e1-ba63-690ccb66dab3', 'volume_size': 1} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-610258537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50feba5f-3176-42e1-ba63-690ccb66dab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099f1662be394f569df84d2cb13ceb96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:30Z,use_quota=True,user_id='7f32fdfd11a543ff9dee9cbee1038a81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:23:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Creating volume 50feba5f-3176-42e1-ba63-690ccb66dab3 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:23:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:23:30 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:23:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:30 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3 1073741824 Jul 23 10:23:30 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:31 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3 1073741824" returned: 0 in 1.030s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:31 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3 Jul 23 10:23:31 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:31 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3" returned: 0 in 0.425s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:23:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f40efde-463a-4091-b106-1c1a3ccbdd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50feba5f-3176-42e1-ba63-690ccb66dab3', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0569186-509e-4e4c-bedd-a7ee6b1bfe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:31 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Volume volume-50feba5f-3176-42e1-ba63-690ccb66dab3 (50feba5f-3176-42e1-ba63-690ccb66dab3): created successfully Jul 23 10:23:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0569186-509e-4e4c-bedd-a7ee6b1bfe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Flow 'volume_create_manager' (31cbcc0a-ee15-4880-afa1-9af592f9c4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:31 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-2679b4e3-d0aa-4d59-b53c-bf71034889e2 tempest-VolumesTransfersV355Test-1290195523 None] Created volume successfully. Jul 23 10:23:33 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1036d6e2-86a0-4116-aae0-32dcb7628fe7 tempest-VolumesTransfersV355Test-201001507 None] Transfer volume completed successfully. Jul 23 10:23:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Acquiring lock "cinder-50feba5f-3176-42e1-ba63-690ccb66dab3-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:23:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Lock "cinder-50feba5f-3176-42e1-ba63-690ccb66dab3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:23:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Acquiring lock "cinder-quobyte-50feba5f-3176-42e1-ba63-690ccb66dab3" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:23:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Lock "cinder-quobyte-50feba5f-3176-42e1-ba63-690ccb66dab3" acquired by "delete_volume" :: waited 0.043s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:23:35 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cc3e26-63f8-4a8a-8469-ca57aeea9f0b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:23:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:35 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3 Jul 23 10:23:35 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:35 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3" returned: 0 in 0.557s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:35 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3 Jul 23 10:23:35 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:36 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50feba5f-3176-42e1-ba63-690ccb66dab3" returned: 0 in 0.669s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:36 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Lock "cinder-quobyte-50feba5f-3176-42e1-ba63-690ccb66dab3" released by "delete_volume" :: held 1.335s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:23:36 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Created reservations ['3020d5ee-a48c-478e-8af8-5d60269e15ee', 'e10ec103-e8f0-4c23-b451-c130e8155d17', '2ac4bad1-c9e7-46ff-94da-eeee1c2b6c7e', '23a06b84-3e03-42cd-b3fa-5b18fb51b2c2'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:23:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:36 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:23:36 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:37 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.759s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:37 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:23:37 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Deleted volume successfully. Jul 23 10:23:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-68c09afd-ca6e-40d4-a040-b424595d35c1 tempest-VolumesTransfersV355Test-1304438161 None] Lock "cinder-50feba5f-3176-42e1-ba63-690ccb66dab3-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Flow 'volume_create_manager' (ad7bcbb7-f866-4971-be40-7883553162aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63b8b0a-5203-430d-b9aa-289100adbad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63b8b0a-5203-430d-b9aa-289100adbad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-332843792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e382883f-239e-4ec3-93b1-b07112a360e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099f1662be394f569df84d2cb13ceb96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:39Z,use_quota=True,user_id='7f32fdfd11a543ff9dee9cbee1038a81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866df9f0-d5f2-4701-9704-8a8a29bc99d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866df9f0-d5f2-4701-9704-8a8a29bc99d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c71cb6-58d0-40ec-beef-a25eb3f0468b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c71cb6-58d0-40ec-beef-a25eb3f0468b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e382883f-239e-4ec3-93b1-b07112a360e7', 'volume_name': 'volume-e382883f-239e-4ec3-93b1-b07112a360e7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ad4c96-a9bc-478d-91ad-6f6f351befb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ad4c96-a9bc-478d-91ad-6f6f351befb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543a909e-1309-4f71-8f3d-f13a486d3002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:38 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Volume e382883f-239e-4ec3-93b1-b07112a360e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e382883f-239e-4ec3-93b1-b07112a360e7', 'volume_size': 1} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-332843792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e382883f-239e-4ec3-93b1-b07112a360e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099f1662be394f569df84d2cb13ceb96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:39Z,use_quota=True,user_id='7f32fdfd11a543ff9dee9cbee1038a81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Creating volume e382883f-239e-4ec3-93b1-b07112a360e7 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:23:38 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:23:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:39 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7 1073741824 Jul 23 10:23:39 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:39 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7 1073741824" returned: 0 in 0.992s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:40 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7 Jul 23 10:23:40 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:40 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7" returned: 0 in 0.513s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:23:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543a909e-1309-4f71-8f3d-f13a486d3002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e382883f-239e-4ec3-93b1-b07112a360e7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7212814b-8149-4ac8-aed8-23e6fcb43d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:40 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Volume volume-e382883f-239e-4ec3-93b1-b07112a360e7 (e382883f-239e-4ec3-93b1-b07112a360e7): created successfully Jul 23 10:23:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7212814b-8149-4ac8-aed8-23e6fcb43d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Flow 'volume_create_manager' (ad7bcbb7-f866-4971-be40-7883553162aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:40 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-21eb6689-170b-47df-bcbd-2e24a1c2ece4 tempest-VolumesTransfersV355Test-1290195523 None] Created volume successfully. Jul 23 10:23:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Acquiring lock "cinder-e382883f-239e-4ec3-93b1-b07112a360e7-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:23:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Lock "cinder-e382883f-239e-4ec3-93b1-b07112a360e7-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:23:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Acquiring lock "cinder-quobyte-e382883f-239e-4ec3-93b1-b07112a360e7" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:23:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Lock "cinder-quobyte-e382883f-239e-4ec3-93b1-b07112a360e7" acquired by "delete_volume" :: waited 0.047s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:23:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72feca4-756e-4ae3-987c-49d1f0a9b34e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:23:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:42 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7 Jul 23 10:23:42 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:42 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7" returned: 0 in 0.936s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:42 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7 Jul 23 10:23:42 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:43 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e382883f-239e-4ec3-93b1-b07112a360e7" returned: 0 in 0.584s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Lock "cinder-quobyte-e382883f-239e-4ec3-93b1-b07112a360e7" released by "delete_volume" :: held 1.636s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:23:43 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Created reservations ['b2dc6234-a1a6-4dfe-a10e-29da907bd716', 'f36a345f-3b51-4ed3-a916-2f9646336e17', '08741795-f834-41f4-b97c-17c661d96e09', '438a7c5e-7196-4de0-9661-2e41803ce066'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:23:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:43 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:23:43 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:44 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.361s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:44 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:23:44 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Deleted volume successfully. Jul 23 10:23:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83a9afb9-ba49-47bf-91f8-87503ae4db4d tempest-VolumesTransfersV355Test-1304438161 None] Lock "cinder-e382883f-239e-4ec3-93b1-b07112a360e7-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:46 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:23:46 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:46 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.343s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 9 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:23:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:23:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Acquiring lock "cinder-dc37b1a8-d043-4338-a46f-ce6140ce62b6-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:23:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Lock "cinder-dc37b1a8-d043-4338-a46f-ce6140ce62b6-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:23:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Acquiring lock "cinder-quobyte-dc37b1a8-d043-4338-a46f-ce6140ce62b6" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:23:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Lock "cinder-quobyte-dc37b1a8-d043-4338-a46f-ce6140ce62b6" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:23:47 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[6887bcc3-9da8-40d5-99ca-17e0a9c257fb]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:23:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:48 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6 Jul 23 10:23:48 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:48 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6" returned: 0 in 0.786s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:48 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6 Jul 23 10:23:48 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:49 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dc37b1a8-d043-4338-a46f-ce6140ce62b6" returned: 0 in 0.600s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Lock "cinder-quobyte-dc37b1a8-d043-4338-a46f-ce6140ce62b6" released by "delete_volume" :: held 1.482s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Created reservations ['ec2dd8d7-5abe-45ca-a4a6-c41ce26f85da', '534ed3c5-7c5e-4c82-96dc-5039f14c9f21', '6fa62384-d0b8-4cdb-b549-bba5b54b01a4', 'f2c18979-a5e2-41f4-8ae9-fd869376f29f'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:49 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:23:49 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:49 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.358s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:23:49 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Deleted volume successfully. Jul 23 10:23:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b8ec601-de06-44bf-acd0-4d43b66e06c4 tempest-ServerRescueNegativeTestJSON-428956319 None] Lock "cinder-dc37b1a8-d043-4338-a46f-ce6140ce62b6-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Flow 'volume_create_manager' (ccbc5b1f-c6e9-4683-9cd7-186ecbc0e0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03403ee-b924-4d63-9f1c-2786f49173f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03403ee-b924-4d63-9f1c-2786f49173f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-775388964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9b8712-0608-4daa-abbb-8bc6306b8e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adb62393bcb4347a92e6249cf1482bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:50Z,use_quota=True,user_id='725d4028c0e64f2591868b64c0f392c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1749fb5-e7d2-49a9-8803-cce57fac755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1749fb5-e7d2-49a9-8803-cce57fac755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6e7f5d-e515-4919-8b70-5fab6d7aa20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6e7f5d-e515-4919-8b70-5fab6d7aa20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb9b8712-0608-4daa-abbb-8bc6306b8e0e', 'volume_name': 'volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b41925-4790-4a46-9109-55bd18ad7afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b41925-4790-4a46-9109-55bd18ad7afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f01f7f-6c04-4b46-a974-4bd3db4d19ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:50 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Volume fb9b8712-0608-4daa-abbb-8bc6306b8e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e', 'volume_size': 1} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-775388964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9b8712-0608-4daa-abbb-8bc6306b8e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adb62393bcb4347a92e6249cf1482bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:50Z,use_quota=True,user_id='725d4028c0e64f2591868b64c0f392c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Creating volume fb9b8712-0608-4daa-abbb-8bc6306b8e0e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:23:50 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:23:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:50 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e 1073741824 Jul 23 10:23:50 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Flow 'volume_create_manager' (0a01490e-787b-4a48-9d73-106008cbaee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20145c7b-95de-430a-a3a9-3605585772ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20145c7b-95de-430a-a3a9-3605585772ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-963964791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adb62393bcb4347a92e6249cf1482bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:51Z,use_quota=True,user_id='725d4028c0e64f2591868b64c0f392c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1669c9-bd63-4901-a9ae-0fec0195ed92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1669c9-bd63-4901-a9ae-0fec0195ed92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe9dde8-eeae-457d-b835-eda45d440758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe9dde8-eeae-457d-b835-eda45d440758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8', 'volume_name': 'volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59bb1c0-d597-4018-809f-9e015f247e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59bb1c0-d597-4018-809f-9e015f247e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27162f85-ef4d-4507-bed3-490ebb0b7ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:51 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Volume 2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8', 'volume_size': 1} Jul 23 10:23:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:52 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e 1073741824" returned: 0 in 1.760s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:52 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e Jul 23 10:23:52 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:52 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e" returned: 0 in 0.418s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.157s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-963964791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adb62393bcb4347a92e6249cf1482bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:51Z,use_quota=True,user_id='725d4028c0e64f2591868b64c0f392c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Creating volume 2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:23:52 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:52 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8 1073741824 Jul 23 10:23:52 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f01f7f-6c04-4b46-a974-4bd3db4d19ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e540261c-b1e4-4974-94de-fdd99368ce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:53 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Volume volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e (fb9b8712-0608-4daa-abbb-8bc6306b8e0e): created successfully Jul 23 10:23:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e540261c-b1e4-4974-94de-fdd99368ce64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Flow 'volume_create_manager' (ccbc5b1f-c6e9-4683-9cd7-186ecbc0e0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9fdacb33-87df-499c-94fe-4a42cb272498 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Created volume successfully. Jul 23 10:23:53 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8 1073741824" returned: 0 in 0.830s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:53 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8 Jul 23 10:23:53 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:54 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8" returned: 0 in 0.454s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:23:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27162f85-ef4d-4507-bed3-490ebb0b7ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841cdbd2-c156-4610-8e7e-bb4d88185d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:54 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Volume volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8 (2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8): created successfully Jul 23 10:23:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841cdbd2-c156-4610-8e7e-bb4d88185d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Flow 'volume_create_manager' (0a01490e-787b-4a48-9d73-106008cbaee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:54 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a418f591-61e3-4fa6-b1e0-2f2315dcb474 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Created volume successfully. Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Flow 'volume_create_manager' (644bd1ed-dcf8-40e4-925b-f39b272fac67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75b11b5-ffcd-4b0f-a024-377c94a99642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75b11b5-ffcd-4b0f-a024-377c94a99642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1307497680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c743e9-f02b-4023-b5b2-24db31ba3efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a986be2cf96546cd80d8d4d7998c86bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:59Z,use_quota=True,user_id='77a9450e0d1b483e9558ed39584286da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff79a6be-43b7-44ec-9dea-7b3aeceb364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff79a6be-43b7-44ec-9dea-7b3aeceb364d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a3df11-afe5-4bef-acfe-c06217b60f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a3df11-afe5-4bef-acfe-c06217b60f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c743e9-f02b-4023-b5b2-24db31ba3efd', 'volume_name': 'volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cb72ab-d800-48d1-9161-e6f19adcf69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cb72ab-d800-48d1-9161-e6f19adcf69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8e5a72-e30a-4fc7-be84-96b37ec00080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:23:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Volume e4c743e9-f02b-4023-b5b2-24db31ba3efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd', 'volume_size': 1} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1307497680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c743e9-f02b-4023-b5b2-24db31ba3efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a986be2cf96546cd80d8d4d7998c86bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:23:59Z,use_quota=True,user_id='77a9450e0d1b483e9558ed39584286da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Creating volume e4c743e9-f02b-4023-b5b2-24db31ba3efd {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:23:59 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:59 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd 1073741824 Jul 23 10:23:59 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:23:59 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd 1073741824" returned: 0 in 0.611s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:23:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:23:59 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd Jul 23 10:23:59 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:00 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd" returned: 0 in 0.369s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:24:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8e5a72-e30a-4fc7-be84-96b37ec00080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4345a72-d46e-4a0c-90ad-5c1e84637b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:00 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Volume volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd (e4c743e9-f02b-4023-b5b2-24db31ba3efd): created successfully Jul 23 10:24:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4345a72-d46e-4a0c-90ad-5c1e84637b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Flow 'volume_create_manager' (644bd1ed-dcf8-40e4-925b-f39b272fac67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1a5cb3cf-e411-4129-8830-4f564836ad14 tempest-VolumesTransfersV357Test-1952625105 None] Created volume successfully. Jul 23 10:24:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-cd0e8b21-ccae-465e-b00a-108f715dd434 tempest-VolumesTransfersV357Test-1791838900 None] Transfer volume completed successfully. Jul 23 10:24:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Acquiring lock "cinder-e4c743e9-f02b-4023-b5b2-24db31ba3efd-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Lock "cinder-e4c743e9-f02b-4023-b5b2-24db31ba3efd-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Acquiring lock "cinder-quobyte-e4c743e9-f02b-4023-b5b2-24db31ba3efd" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Lock "cinder-quobyte-e4c743e9-f02b-4023-b5b2-24db31ba3efd" acquired by "delete_volume" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:03 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafa64a5-0269-4ab3-ae68-15ee918245b1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:03 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd Jul 23 10:24:03 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:04 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd" returned: 0 in 0.558s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:04 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd Jul 23 10:24:04 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:04 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4c743e9-f02b-4023-b5b2-24db31ba3efd" returned: 0 in 0.301s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Lock "cinder-quobyte-e4c743e9-f02b-4023-b5b2-24db31ba3efd" released by "delete_volume" :: held 0.957s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Created reservations ['fa0e02d4-abb5-4274-8ba4-32ecb01fee19', '4853a9f5-1050-4dee-88f6-f17ce3a44fec', '838bd022-f221-40cb-b840-493e84f31e13', 'b74a79e3-6b50-4064-b084-c0b983b1d952'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:04 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:24:04 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:04 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.277s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:24:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Deleted volume successfully. Jul 23 10:24:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae4f1f99-5c3d-49d4-9925-e84c4bd61a0f tempest-VolumesTransfersV357Test-540581877 None] Lock "cinder-e4c743e9-f02b-4023-b5b2-24db31ba3efd-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:06 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:24:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Flow 'volume_create_manager' (626fc3b7-870d-4116-b2d1-b63bb010e0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0a0d4e-74b0-4e89-b74d-4bc7e1fdd997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:06 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:24:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Flow 'volume_create_manager' (3cc5037a-b5f1-449b-8b45-f04c34566c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23230a91-5dc9-43ee-aaa7-bdc31a4fc60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0a0d4e-74b0-4e89-b74d-4bc7e1fdd997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-413978397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f725ba-1b86-43b8-a593-275c71c0f413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a986be2cf96546cd80d8d4d7998c86bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:24:07Z,use_quota=True,user_id='77a9450e0d1b483e9558ed39584286da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64040548-92d0-4399-9330-a0af38498c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64040548-92d0-4399-9330-a0af38498c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9843036a-aa66-4ddb-8fcb-325147347c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9843036a-aa66-4ddb-8fcb-325147347c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f725ba-1b86-43b8-a593-275c71c0f413', 'volume_name': 'volume-19f725ba-1b86-43b8-a593-275c71c0f413', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c843ff10-3a2d-4813-9dd7-db2b9cfb93aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c843ff10-3a2d-4813-9dd7-db2b9cfb93aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b9ce8f-e7da-4dd8-8799-5a04d8fafa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:07 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Volume 19f725ba-1b86-43b8-a593-275c71c0f413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f725ba-1b86-43b8-a593-275c71c0f413', 'volume_size': 1} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-413978397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f725ba-1b86-43b8-a593-275c71c0f413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a986be2cf96546cd80d8d4d7998c86bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:24:07Z,use_quota=True,user_id='77a9450e0d1b483e9558ed39584286da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Creating volume 19f725ba-1b86-43b8-a593-275c71c0f413 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:24:07 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23230a91-5dc9-43ee-aaa7-bdc31a4fc60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1286371022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b551acc-f6c3-4adc-8916-1102cac2e6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdcaf6e3fe39460c8b1001ac55fe4719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:24:07Z,use_quota=True,user_id='80a73ab13ef348e3b03decf471f7fad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:07 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413 1073741824 Jul 23 10:24:07 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71776cd-7ae3-42ee-8383-dc19c5d8ff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71776cd-7ae3-42ee-8383-dc19c5d8ff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de3487e-9c37-4536-ba38-e161090b3f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de3487e-9c37-4536-ba38-e161090b3f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b551acc-f6c3-4adc-8916-1102cac2e6bf', 'volume_name': 'volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbb2bc9-bf42-4596-8570-fbb253814c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbb2bc9-bf42-4596-8570-fbb253814c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18883862-f37f-4af3-9325-661dd47c8048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:07 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Volume 2b551acc-f6c3-4adc-8916-1102cac2e6bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf', 'volume_size': 1} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:07 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413 1073741824" returned: 0 in 0.744s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:07 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413 Jul 23 10:24:07 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:08 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413" returned: 0 in 0.412s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.131s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1286371022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b551acc-f6c3-4adc-8916-1102cac2e6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdcaf6e3fe39460c8b1001ac55fe4719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:24:07Z,use_quota=True,user_id='80a73ab13ef348e3b03decf471f7fad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Creating volume 2b551acc-f6c3-4adc-8916-1102cac2e6bf {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:24:08 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b9ce8f-e7da-4dd8-8799-5a04d8fafa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f725ba-1b86-43b8-a593-275c71c0f413', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0011a6-459b-4d27-9a56-6d5647e39f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:08 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Volume volume-19f725ba-1b86-43b8-a593-275c71c0f413 (19f725ba-1b86-43b8-a593-275c71c0f413): created successfully Jul 23 10:24:08 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf 1073741824 Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0011a6-459b-4d27-9a56-6d5647e39f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:08 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Flow 'volume_create_manager' (626fc3b7-870d-4116-b2d1-b63bb010e0ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:08 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-99fb7ad3-fa96-4fb7-a7f1-9e918a3514ac tempest-VolumesTransfersV357Test-1952625105 None] Created volume successfully. Jul 23 10:24:09 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf 1073741824" returned: 0 in 0.878s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Acquiring lock "cinder-19f725ba-1b86-43b8-a593-275c71c0f413-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Lock "cinder-19f725ba-1b86-43b8-a593-275c71c0f413-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:09 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf Jul 23 10:24:09 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Acquiring lock "cinder-quobyte-19f725ba-1b86-43b8-a593-275c71c0f413" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Lock "cinder-quobyte-19f725ba-1b86-43b8-a593-275c71c0f413" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd86751c-b857-499f-a495-40e118c700a2]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:09 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413 Jul 23 10:24:09 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:09 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf" returned: 0 in 0.297s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18883862-f37f-4af3-9325-661dd47c8048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26836606-2cb7-42be-9190-60266d87eaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:09 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Volume volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf (2b551acc-f6c3-4adc-8916-1102cac2e6bf): created successfully Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26836606-2cb7-42be-9190-60266d87eaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Flow 'volume_create_manager' (3cc5037a-b5f1-449b-8b45-f04c34566c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:09 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-46b7e326-f2d0-4bc5-812c-dc0fe744cb9c tempest-AttachVolumeShelveTestJSON-1442305901 None] Created volume successfully. Jul 23 10:24:09 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413" returned: 0 in 0.446s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:09 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413 Jul 23 10:24:09 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:10 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-19f725ba-1b86-43b8-a593-275c71c0f413" returned: 0 in 0.290s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Lock "cinder-quobyte-19f725ba-1b86-43b8-a593-275c71c0f413" released by "delete_volume" :: held 0.796s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Created reservations ['17fc5526-dafb-493e-aa45-50e9d406d9b6', '9468ac4a-4c26-4370-b03f-1e7925a76920', 'bc3c3c0b-4c60-41d7-bdb0-ba4e906b8228', '2bbd01ee-e3f1-4a1c-9fa2-647dc10b7cd5'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:10 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:24:10 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:10 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.390s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:24:10 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Deleted volume successfully. Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=70,cinder:INSERT=20,cinder:DELETE=8,cinder:SELECT=48 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:24:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a3282c7-9e5c-4764-8ac6-cedf69f9fba5 tempest-VolumesTransfersV357Test-540581877 None] Lock "cinder-19f725ba-1b86-43b8-a593-275c71c0f413-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=50,cinder:UPDATE=80,cinder:INSERT=13,cinder:DELETE=7 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Flow 'volume_create_manager' (f6505e7b-5006-4cb3-8a4f-d12c171e7b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d03a00f-93d1-4567-a304-6cdda83ab3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d03a00f-93d1-4567-a304-6cdda83ab3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1049121269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d09dc14-505e-43fb-9c37-7d1ad22985c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b03b5a36bf4bb3afb05f8f7d2e33a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:24:20Z,use_quota=True,user_id='fc36977485e94140b52226bac94787e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974abb2b-90b7-4263-bc63-95e1a29e02b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974abb2b-90b7-4263-bc63-95e1a29e02b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074286d2-cea1-47e5-96df-7e5e3818193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074286d2-cea1-47e5-96df-7e5e3818193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d09dc14-505e-43fb-9c37-7d1ad22985c4', 'volume_name': 'volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80906ce7-02ce-4fca-b00d-a5e8b3417ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80906ce7-02ce-4fca-b00d-a5e8b3417ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a833e9-b727-49c0-b485-1f8960417860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:20 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Volume 3d09dc14-505e-43fb-9c37-7d1ad22985c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4', 'volume_size': 1} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1049121269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d09dc14-505e-43fb-9c37-7d1ad22985c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b03b5a36bf4bb3afb05f8f7d2e33a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:24:20Z,use_quota=True,user_id='fc36977485e94140b52226bac94787e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Creating volume 3d09dc14-505e-43fb-9c37-7d1ad22985c4 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:24:20 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:24:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:20 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 1073741824 Jul 23 10:24:20 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:21 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 1073741824" returned: 0 in 0.742s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:21 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 Jul 23 10:24:21 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:21 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4" returned: 0 in 0.311s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:24:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a833e9-b727-49c0-b485-1f8960417860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fa6dd5-1022-4d51-b67d-a0b5e13ea881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:21 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Volume volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 (3d09dc14-505e-43fb-9c37-7d1ad22985c4): created successfully Jul 23 10:24:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fa6dd5-1022-4d51-b67d-a0b5e13ea881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Flow 'volume_create_manager' (f6505e7b-5006-4cb3-8a4f-d12c171e7b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:21 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-96cbb943-e277-4ee1-b03d-2cc3d66415d7 tempest-VolumesCloneTest-1683723735 None] Created volume successfully. Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Flow 'volume_create_manager' (f69f4c87-a787-4071-afd0-c6ce3554e055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767b24c9-8427-493e-b802-93c9f66a7748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767b24c9-8427-493e-b802-93c9f66a7748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1737683833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923968b3-ea0e-4d7c-8175-636411a16197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b03b5a36bf4bb3afb05f8f7d2e33a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:24:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3d09dc14-505e-43fb-9c37-7d1ad22985c4,status='creating',terminated_at=None,updated_at=2026-07-23T08:24:23Z,use_quota=True,user_id='fc36977485e94140b52226bac94787e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214a5d74-cf44-48e6-a967-7ee96d404958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214a5d74-cf44-48e6-a967-7ee96d404958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ad63f0-ed7b-451b-ac30-4d3780fa2051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ad63f0-ed7b-451b-ac30-4d3780fa2051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '923968b3-ea0e-4d7c-8175-636411a16197', 'volume_name': 'volume-923968b3-ea0e-4d7c-8175-636411a16197', 'volume_size': 2, 'source_volid': '3d09dc14-505e-43fb-9c37-7d1ad22985c4', 'source_volstatus': 'available'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6141c1f9-3e8e-4af1-9c1f-d43f0f9790ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6141c1f9-3e8e-4af1-9c1f-d43f0f9790ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9ef366-f788-46a3-baad-4dae4e770c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:23 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Volume 923968b3-ea0e-4d7c-8175-636411a16197: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-923968b3-ea0e-4d7c-8175-636411a16197', 'volume_size': 2, 'source_volid': '3d09dc14-505e-43fb-9c37-7d1ad22985c4', 'source_volstatus': 'available'} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:23 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Cloning volume 3d09dc14-505e-43fb-9c37-7d1ad22985c4 to volume 923968b3-ea0e-4d7c-8175-636411a16197 Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Creating offline snapshot 75d4d4a0-8812-440b-b758-9c9d70774251 of volume 3d09dc14-505e-43fb-9c37-7d1ad22985c4 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b6175-e62a-4ff9-ba59-e5e7b8325ed2]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:23 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 Jul 23 10:24:23 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-74bc5e36-7fe3-459b-82d3-f87aa02b77bc req-ace55f1b-08d5-4469-86fa-cc85cbaae9f8 tempest-AttachVolumeShelveTestJSON-1442305901 None] No connector for attachment d02f8773-85bc-4112-9d18-dc59f52214f0; skipping storage backend terminate_connection call. {{(pid=88371) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-74bc5e36-7fe3-459b-82d3-f87aa02b77bc req-ace55f1b-08d5-4469-86fa-cc85cbaae9f8 tempest-AttachVolumeShelveTestJSON-1442305901 None] Deleting attachment d02f8773-85bc-4112-9d18-dc59f52214f0. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:24:23 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4" returned: 0 in 0.414s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:23 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 1G Jul 23 10:24:23 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:24 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 1G" returned: 0 in 0.575s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:24 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 Jul 23 10:24:24 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:24 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251" returned: 0 in 0.342s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:24 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 is being set with open permissions: ugo+rw Jul 23 10:24:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:24 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 Jul 23 10:24:24 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:25 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:25 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.info Jul 23 10:24:25 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:25 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.info" returned: 0 in 0.421s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:25 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.info is being set with open permissions: ugo+rw Jul 23 10:24:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:25 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.info Jul 23 10:24:25 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:26 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.info" returned: 0 in 0.460s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Acquiring lock "cinder-quobyte-923968b3-ea0e-4d7c-8175-636411a16197" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Lock "cinder-quobyte-923968b3-ea0e-4d7c-8175-636411a16197" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] snapshot: 75d4d4a0-8812-440b-b758-9c9d70774251, volume: 923968b3-ea0e-4d7c-8175-636411a16197, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[277bc0ce-64b6-4e3f-99ab-86df7d1815cd]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:26 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 Jul 23 10:24:26 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:26 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251" returned: 0 in 0.561s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ec28a0-d9a0-4320-8751-7f8210e0d191]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:27 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 Jul 23 10:24:27 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:27 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4" returned: 0 in 0.643s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:27 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197 not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:24:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:27 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197 Jul 23 10:24:27 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-0112584c-9f7b-4b3a-a6ed-79095cbf4f44 req-2602d6a3-b102-4044-bb9d-3c2a0f50c792 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:34 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197" returned: 0 in 6.930s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:34 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[818a2f83-e9f5-4489-8e83-8581aabc3d93]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:34 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 Jul 23 10:24:34 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:35 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4" returned: 0 in 0.740s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:24:35 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Converted 1024.00 MB image at 147.72 MB/s Jul 23 10:24:35 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197 is being set with open permissions: ugo+rw Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1,cinder:INSERT=2 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:24:35 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197 Jul 23 10:24:35 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:35 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197" returned: 0 in 0.297s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Lock "cinder-quobyte-923968b3-ea0e-4d7c-8175-636411a16197" released by "_copy_volume_from_snapshot" :: held 9.342s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Acquiring lock "cinder-quobyte-75d4d4a0-8812-440b-b758-9c9d70774251" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Lock "cinder-quobyte-75d4d4a0-8812-440b-b758-9c9d70774251" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Deleting offline snapshot 75d4d4a0-8812-440b-b758-9c9d70774251 of volume 3d09dc14-505e-43fb-9c37-7d1ad22985c4 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] snapshot_file for this snap is: volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09c62aa-3cc1-44a3-87fa-04d7ed5c9877]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:35 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 Jul 23 10:24:35 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:36 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251" returned: 0 in 0.526s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:24:36 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2128b7bf-d4cd-415e-9fe8-6e33859a0400]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:36 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 Jul 23 10:24:36 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:36 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4" returned: 0 in 0.435s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:36 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 Jul 23 10:24:36 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:37 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251" returned: 0 in 0.428s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:37 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251 Jul 23 10:24:37 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:37 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4.75d4d4a0-8812-440b-b758-9c9d70774251" returned: 0 in 0.301s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Lock "cinder-quobyte-75d4d4a0-8812-440b-b758-9c9d70774251" released by "_delete_snapshot" :: held 1.827s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.168s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-0112584c-9f7b-4b3a-a6ed-79095cbf4f44 req-2602d6a3-b102-4044-bb9d-3c2a0f50c792 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.463s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9ef366-f788-46a3-baad-4dae4e770c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923968b3-ea0e-4d7c-8175-636411a16197', 'volume_size': 2, 'source_volid': '3d09dc14-505e-43fb-9c37-7d1ad22985c4', 'source_volstatus': 'available'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54697d18-1c6a-455d-aa9b-12b989d44e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-0112584c-9f7b-4b3a-a6ed-79095cbf4f44 req-2602d6a3-b102-4044-bb9d-3c2a0f50c792 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:37 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Volume volume-923968b3-ea0e-4d7c-8175-636411a16197 (923968b3-ea0e-4d7c-8175-636411a16197): created successfully Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54697d18-1c6a-455d-aa9b-12b989d44e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Flow 'volume_create_manager' (f69f4c87-a787-4071-afd0-c6ce3554e055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:37 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-dac0c391-afb4-4245-8cf1-41d82ab74079 tempest-VolumesCloneTest-1683723735 None] Created volume successfully. Jul 23 10:24:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-0112584c-9f7b-4b3a-a6ed-79095cbf4f44 req-2602d6a3-b102-4044-bb9d-3c2a0f50c792 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24c31c18-be83-45a0-a9d1-353d0d645014', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:24:37 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-0112584c-9f7b-4b3a-a6ed-79095cbf4f44 req-2602d6a3-b102-4044-bb9d-3c2a0f50c792 tempest-TestServerVolumeAttachmentScenario-1955517515 None] attachment_update completed successfully. Jul 23 10:24:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Acquiring lock "cinder-923968b3-ea0e-4d7c-8175-636411a16197-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Lock "cinder-923968b3-ea0e-4d7c-8175-636411a16197-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Acquiring lock "cinder-quobyte-923968b3-ea0e-4d7c-8175-636411a16197" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Lock "cinder-quobyte-923968b3-ea0e-4d7c-8175-636411a16197" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:38 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c58aeaf-c6ff-42ac-91ea-e969656a3d4c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:39 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197 Jul 23 10:24:39 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:39 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197" returned: 0 in 0.806s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:39 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197 Jul 23 10:24:39 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:40 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-923968b3-ea0e-4d7c-8175-636411a16197" returned: 0 in 0.418s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Lock "cinder-quobyte-923968b3-ea0e-4d7c-8175-636411a16197" released by "delete_volume" :: held 1.366s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:40 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Created reservations ['bfeb37e6-4203-4d76-9b31-c9d4c3006765', '66c3248d-205a-4771-b166-4dae9b4fdcfa', '4b65d74f-2bb3-4523-b57f-29eb98efb942', '8f39c89d-de4c-4a0d-94e9-b43d41cb4fe9'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:24:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:40 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:24:40 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:41 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.586s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:41 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:24:41 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Deleted volume successfully. Jul 23 10:24:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3095d4ad-5ac7-4d8f-ab57-8a92ec7396d4 tempest-VolumesCloneTest-1683723735 None] Lock "cinder-923968b3-ea0e-4d7c-8175-636411a16197-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Acquiring lock "cinder-3d09dc14-505e-43fb-9c37-7d1ad22985c4-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Lock "cinder-3d09dc14-505e-43fb-9c37-7d1ad22985c4-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Acquiring lock "cinder-quobyte-3d09dc14-505e-43fb-9c37-7d1ad22985c4" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Lock "cinder-quobyte-3d09dc14-505e-43fb-9c37-7d1ad22985c4" acquired by "delete_volume" :: waited 0.039s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d8ec77-1bcd-4e4e-802c-3f3335e95a95]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:41 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 Jul 23 10:24:41 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:42 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4" returned: 0 in 0.509s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:42 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4 Jul 23 10:24:42 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:42 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3d09dc14-505e-43fb-9c37-7d1ad22985c4" returned: 0 in 0.347s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Lock "cinder-quobyte-3d09dc14-505e-43fb-9c37-7d1ad22985c4" released by "delete_volume" :: held 1.013s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:42 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Created reservations ['ae0d9065-c84c-4056-9886-dbbf049d6f6b', 'b66106b6-6b10-4934-a60d-10c3ade37618', 'e7eb680a-2f7a-4c31-8e94-e06d4f9981c8', '6205a12f-0257-4bce-95e5-7cefc08297ff'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:24:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:42 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:24:42 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:43 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.447s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:43 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:24:43 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Deleted volume successfully. Jul 23 10:24:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cf402aa-e081-49d7-b00d-bbf20cd810bd tempest-VolumesCloneTest-1683723735 None] Lock "cinder-3d09dc14-505e-43fb-9c37-7d1ad22985c4-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:46 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:24:46 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-ef7c5372-b681-4bfa-a714-4b68d5a8953f req-b41fb3a0-0d55-40dc-961d-1d6f7650871c tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-ef7c5372-b681-4bfa-a714-4b68d5a8953f req-b41fb3a0-0d55-40dc-961d-1d6f7650871c tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-ef7c5372-b681-4bfa-a714-4b68d5a8953f req-b41fb3a0-0d55-40dc-961d-1d6f7650871c tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-ef7c5372-b681-4bfa-a714-4b68d5a8953f req-b41fb3a0-0d55-40dc-961d-1d6f7650871c tempest-TestServerVolumeAttachmentScenario-1955517515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89833ccb-b158-42c5-a5cb-7a41ff64391c', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:24:46 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-ef7c5372-b681-4bfa-a714-4b68d5a8953f req-b41fb3a0-0d55-40dc-961d-1d6f7650871c tempest-TestServerVolumeAttachmentScenario-1955517515 None] attachment_update completed successfully. Jul 23 10:24:46 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.455s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 9 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:24:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:24:48 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:24:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Flow 'volume_create_manager' (9ebdf999-e757-420a-8350-6f9cf13a94b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cdfb8b-2563-4377-9e1b-d714dbc8fb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cdfb8b-2563-4377-9e1b-d714dbc8fb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1526683912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd2d505-743e-4a7f-82e2-c57e3f10765c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2448b069ba411db1d599a323c09631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:24:49Z,use_quota=True,user_id='47c8940b6a5c4725900a1f20ca1667ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2789e082-b3fb-4649-a3af-b0e48001e51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2789e082-b3fb-4649-a3af-b0e48001e51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4728fc-8b58-475e-a8cb-e9fe3ee25d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:48 devstack cinder-volume[88371]: DEBUG cinder.image.glance [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Creating Keystone auth plugin from conf {{(pid=88371) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 10:24:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4728fc-8b58-475e-a8cb-e9fe3ee25d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ecd2d505-743e-4a7f-82e2-c57e3f10765c', 'volume_name': 'volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4852f95c-b6a0-4e3f-8eb8-cb5fcd650fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4852f95c-b6a0-4e3f-8eb8-cb5fcd650fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e32c52-cf12-4bae-bf5b-d4f7e52b6e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:49 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Volume ecd2d505-743e-4a7f-82e2-c57e3f10765c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 10:24:49 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Trying to clone ecd2d505-743e-4a7f-82e2-c57e3f10765c from image c7e93a9b-febb-49a8-91b3-5378e004c880 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]). {{(pid=88371) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 10:24:49 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-c20569c7-6313-4785-b85e-00be618520c3 req-4dad14eb-f50c-4b6b-9272-384c4047afab tempest-TestServerVolumeAttachmentScenario-1955517515 None] Terminate volume connection completed successfully. Jul 23 10:24:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-c20569c7-6313-4785-b85e-00be618520c3 req-4dad14eb-f50c-4b6b-9272-384c4047afab tempest-TestServerVolumeAttachmentScenario-1955517515 None] Deleting attachment 89833ccb-b158-42c5-a5cb-7a41ff64391c. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:24:49 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 10:24:49 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Image download 20.69 MB at 20.69 MB/s Jul 23 10:24:49 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[610950e6-01c0-4a98-80a0-9ff69e9329d2]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:50 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD Jul 23 10:24:50 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:50 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Temporary image c7e93a9b-febb-49a8-91b3-5378e004c880 is fetched for user 47c8940b6a5c4725900a1f20ca1667ca. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f859108-ef98-43af-bc99-174709b0974b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:50 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD Jul 23 10:24:50 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:50 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD" returned: 0 in 0.337s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1526683912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd2d505-743e-4a7f-82e2-c57e3f10765c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2448b069ba411db1d599a323c09631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:24:49Z,use_quota=True,user_id='47c8940b6a5c4725900a1f20ca1667ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Creating volume ecd2d505-743e-4a7f-82e2-c57e3f10765c {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:24:50 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:24:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:50 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c 1073741824 Jul 23 10:24:50 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:51 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-d7eff207-44cf-418c-a30d-d6c4c64bbc06 req-5c815709-a616-4742-b7e9-6ee38e694957 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Terminate volume connection completed successfully. Jul 23 10:24:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-d7eff207-44cf-418c-a30d-d6c4c64bbc06 req-5c815709-a616-4742-b7e9-6ee38e694957 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Deleting attachment 24c31c18-be83-45a0-a9d1-353d0d645014. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:24:51 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c 1073741824" returned: 0 in 0.503s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:51 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c Jul 23 10:24:51 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:51 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c" returned: 0 in 0.268s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:24:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:51 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Attempting download of c7e93a9b-febb-49a8-91b3-5378e004c880 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}])) to volume ecd2d505-743e-4a7f-82e2-c57e3f10765c. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 10:24:51 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55da048-0d8b-4b20-bab4-9f56e6d28946]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_jeebenmc {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:51 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_jeebenmc Jul 23 10:24:51 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:52 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_jeebenmc" returned: 0 in 0.396s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_jeebenmc {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:52 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_jeebenmc Jul 23 10:24:52 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:52 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_jeebenmc" returned: 1 in 0.399s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_jeebenmc' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:24:52 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3606ba3c-8eb8-41ab-8c88-e1d3a5c8c05f]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:52 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD Jul 23 10:24:52 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:52 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD" returned: 0 in 0.553s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:52 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] c7e93a9b-febb-49a8-91b3-5378e004c880 was qcow2, converting to qcow2 {{(pid=88371) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 10:24:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:53 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c Jul 23 10:24:53 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:55 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c" returned: 0 in 2.538s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:55 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_2sal_060devstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:24:55 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Converted 112.00 MB image at 44.11 MB/s Jul 23 10:24:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:55 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c 1G Jul 23 10:24:55 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:55 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c 1G" returned: 0 in 0.360s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:55 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Downloaded image c7e93a9b-febb-49a8-91b3-5378e004c880 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}])) to volume ecd2d505-743e-4a7f-82e2-c57e3f10765c successfully. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 10:24:55 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Temporary image c7e93a9b-febb-49a8-91b3-5378e004c880 for user 47c8940b6a5c4725900a1f20ca1667ca is deleted. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 10:24:55 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Marking volume ecd2d505-743e-4a7f-82e2-c57e3f10765c as bootable. {{(pid=88371) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 10:24:55 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Copying metadata from image c7e93a9b-febb-49a8-91b3-5378e004c880 to ecd2d505-743e-4a7f-82e2-c57e3f10765c. {{(pid=88371) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 10:24:55 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Creating volume glance metadata for volume ecd2d505-743e-4a7f-82e2-c57e3f10765c backed by image c7e93a9b-febb-49a8-91b3-5378e004c880 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88371) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 10:24:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e32c52-cf12-4bae-bf5b-d4f7e52b6e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1724585a-2bbb-4bc5-8989-a9ff8d9ab5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:56 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Volume volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c (ecd2d505-743e-4a7f-82e2-c57e3f10765c): created successfully Jul 23 10:24:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1724585a-2bbb-4bc5-8989-a9ff8d9ab5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Flow 'volume_create_manager' (9ebdf999-e757-420a-8350-6f9cf13a94b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:56 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fc58d1b8-f2e5-4ab4-b60b-e88db0116fd5 tempest-VolumesExtendTest-612644769 None] Created volume successfully. Jul 23 10:24:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b372ec86-4d6a-46db-9d70-c688ef2a18c4 tempest-VolumesExtendTest-612644769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b372ec86-4d6a-46db-9d70-c688ef2a18c4 tempest-VolumesExtendTest-612644769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:56 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8d7d0f-ba5f-4c71-a501-790ce4ea3717]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b372ec86-4d6a-46db-9d70-c688ef2a18c4 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:56 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c Jul 23 10:24:56 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:57 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b372ec86-4d6a-46db-9d70-c688ef2a18c4 tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c" returned: 0 in 0.480s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b372ec86-4d6a-46db-9d70-c688ef2a18c4 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c 2G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "cinder-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "cinder-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "cinder-quobyte-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "cinder-quobyte-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8" acquired by "delete_volume" :: waited 0.030s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b372ec86-4d6a-46db-9d70-c688ef2a18c4 tempest-VolumesExtendTest-612644769 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c 2G" returned: 0 in 0.184s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b372ec86-4d6a-46db-9d70-c688ef2a18c4 tempest-VolumesExtendTest-612644769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.699s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f87458d-bb90-4194-b071-cc118f765ed6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b372ec86-4d6a-46db-9d70-c688ef2a18c4 tempest-VolumesExtendTest-612644769 None] Extend volume completed successfully. Jul 23 10:24:57 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8 Jul 23 10:24:57 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:57 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8" returned: 0 in 0.407s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:57 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8 Jul 23 10:24:57 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Acquiring lock "cinder-ecd2d505-743e-4a7f-82e2-c57e3f10765c-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Lock "cinder-ecd2d505-743e-4a7f-82e2-c57e3f10765c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Acquiring lock "cinder-quobyte-ecd2d505-743e-4a7f-82e2-c57e3f10765c" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Lock "cinder-quobyte-ecd2d505-743e-4a7f-82e2-c57e3f10765c" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e843d0-4a9a-4b08-89b5-a482789544fa]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:58 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8" returned: 0 in 0.299s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "cinder-quobyte-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8" released by "delete_volume" :: held 0.751s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Created reservations ['4f9cc495-cc12-4f3e-9f14-3c508b7090d9', 'b10d78af-7cb0-4588-a02f-e6a69662bf3a', 'bb0af766-851f-4d62-b227-1646084fbaa8', 'e5040366-6be3-4d95-805e-7f531545d152'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:24:58 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c Jul 23 10:24:58 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:58 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:24:58 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "cinder-fb9b8712-0608-4daa-abbb-8bc6306b8e0e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:58 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.273s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "cinder-fb9b8712-0608-4daa-abbb-8bc6306b8e0e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:58 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Deleted volume successfully. Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-88bfb1c9-27d7-47cf-a4e7-407c4bfdde4b tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "cinder-2c1d26c0-ef35-4d76-9b5b-63ed80bb8db8-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "cinder-quobyte-fb9b8712-0608-4daa-abbb-8bc6306b8e0e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "cinder-quobyte-fb9b8712-0608-4daa-abbb-8bc6306b8e0e" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:24:58 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c" returned: 0 in 0.556s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd039ab-2ea9-4899-99c2-a7066cf3defc]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:58 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c Jul 23 10:24:58 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:58 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e Jul 23 10:24:58 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:58 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ecd2d505-743e-4a7f-82e2-c57e3f10765c" returned: 0 in 0.259s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Lock "cinder-quobyte-ecd2d505-743e-4a7f-82e2-c57e3f10765c" released by "delete_volume" :: held 0.864s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:58 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Created reservations ['1fc2a0f6-afa2-49a5-8ca0-7d25a8458973', '99317116-86e2-4475-96f6-e930a542825d', '7ce469c4-a696-4cc8-b330-e094184f16a5', 'b675201b-948a-4d94-aeb9-333726d2bee6'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:59 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e" returned: 0 in 0.413s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:59 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:24:59 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:59 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e Jul 23 10:24:59 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:59 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:59 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fb9b8712-0608-4daa-abbb-8bc6306b8e0e" returned: 0 in 0.296s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.324s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "cinder-quobyte-fb9b8712-0608-4daa-abbb-8bc6306b8e0e" released by "delete_volume" :: held 0.768s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Deleted volume successfully. Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4fe4dcd-a415-4edd-9f63-7fa7c1794727 tempest-VolumesExtendTest-612644769 None] Lock "cinder-ecd2d505-743e-4a7f-82e2-c57e3f10765c-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Created reservations ['03ef516f-6d80-47c5-b3e8-6e55076facc3', '6d729eb6-c5b9-435d-a663-c3f7a500ff46', 'aecc1939-6e3c-4694-8c7c-535ea4175a9d', 'f438c1c0-ed96-4492-b35e-962f312c5280'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:59 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:24:59 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Flow 'volume_create_manager' (60ef9dfe-7943-4752-ac0d-80a8721228f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745c26cf-969f-486c-b942-b20c667b37ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745c26cf-969f-486c-b942-b20c667b37ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-927227337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bc05ab-d605-440f-acb5-83c472a99168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2448b069ba411db1d599a323c09631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:00Z,use_quota=True,user_id='47c8940b6a5c4725900a1f20ca1667ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0e1561-1916-4e58-9026-0abf867a0c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0e1561-1916-4e58-9026-0abf867a0c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700d7f5c-66be-4336-a38c-c8236787c73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700d7f5c-66be-4336-a38c-c8236787c73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84bc05ab-d605-440f-acb5-83c472a99168', 'volume_name': 'volume-84bc05ab-d605-440f-acb5-83c472a99168', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf429bba-b253-48fe-8ddd-592c092a781c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf429bba-b253-48fe-8ddd-592c092a781c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f549e642-a3e2-475e-8438-512cb7ebd417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:24:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Volume 84bc05ab-d605-440f-acb5-83c472a99168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84bc05ab-d605-440f-acb5-83c472a99168', 'volume_size': 1} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-927227337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bc05ab-d605-440f-acb5-83c472a99168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2448b069ba411db1d599a323c09631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:00Z,use_quota=True,user_id='47c8940b6a5c4725900a1f20ca1667ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Creating volume 84bc05ab-d605-440f-acb5-83c472a99168 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:24:59 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:24:59 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.419s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:24:59 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:25:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Deleted volume successfully. Jul 23 10:25:00 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 1073741824 Jul 23 10:25:00 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-80a62b2a-4136-41de-878e-48fbd98a63f9 tempest-TestServerVolumeAttachmentScenario-1955517515 None] Lock "cinder-fb9b8712-0608-4daa-abbb-8bc6306b8e0e-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Flow 'volume_create_manager' (44da4f4a-f95a-4c49-bae5-16d5034e0b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a63452-2bc3-4c8e-914b-d5f16d97f56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a63452-2bc3-4c8e-914b-d5f16d97f56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1714950855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c51fa9-3dc9-4144-8a56-d3e44e7d9592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feed3a99ac4482ac0b9559176e6518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:00Z,use_quota=True,user_id='25d0291f31be4db290fb7587c73cf2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6082e134-d104-4599-9bba-8a8b8e3e6ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6082e134-d104-4599-9bba-8a8b8e3e6ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0921a1f9-20f5-4cce-b068-e8eea330f6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0921a1f9-20f5-4cce-b068-e8eea330f6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c51fa9-3dc9-4144-8a56-d3e44e7d9592', 'volume_name': 'volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1c0052-7549-47d8-b8f6-fc088e349392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1c0052-7549-47d8-b8f6-fc088e349392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dd98da-5b1c-4ace-897c-c7b37e98a433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:00 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Volume c1c51fa9-3dc9-4144-8a56-d3e44e7d9592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592', 'volume_size': 1} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:00 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 1073741824" returned: 0 in 0.485s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:00 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 Jul 23 10:25:00 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:00 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168" returned: 0 in 0.263s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.602s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1714950855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c51fa9-3dc9-4144-8a56-d3e44e7d9592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feed3a99ac4482ac0b9559176e6518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:00Z,use_quota=True,user_id='25d0291f31be4db290fb7587c73cf2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Creating volume c1c51fa9-3dc9-4144-8a56-d3e44e7d9592 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:25:00 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:00 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592 1073741824 Jul 23 10:25:00 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f549e642-a3e2-475e-8438-512cb7ebd417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84bc05ab-d605-440f-acb5-83c472a99168', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b608fdae-33f4-4cc9-ae0f-5701786beff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:00 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Volume volume-84bc05ab-d605-440f-acb5-83c472a99168 (84bc05ab-d605-440f-acb5-83c472a99168): created successfully Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b608fdae-33f4-4cc9-ae0f-5701786beff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Flow 'volume_create_manager' (60ef9dfe-7943-4752-ac0d-80a8721228f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9817eeef-9694-4bad-bad5-648c0c584cb3 tempest-VolumesExtendTest-612644769 None] Created volume successfully. Jul 23 10:25:01 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592 1073741824" returned: 0 in 0.481s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:01 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592 Jul 23 10:25:01 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:01 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592" returned: 0 in 0.265s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dd98da-5b1c-4ace-897c-c7b37e98a433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06533d07-88b3-487b-bc6b-4f24dded15a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:01 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Volume volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592 (c1c51fa9-3dc9-4144-8a56-d3e44e7d9592): created successfully Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06533d07-88b3-487b-bc6b-4f24dded15a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Flow 'volume_create_manager' (44da4f4a-f95a-4c49-bae5-16d5034e0b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7f45ecdc-91a1-4c99-942d-a2e61213d495 tempest-AttachVolumeTestJSON-1879274770 None] Created volume successfully. Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] Creating offline snapshot 304c4e3a-9d57-43b1-bec5-2af2d5caefd6 of volume 84bc05ab-d605-440f-acb5-83c472a99168 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:25:01 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a8ec73-e2dd-426b-a62a-843937f88a53]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:02 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 Jul 23 10:25:02 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:02 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168" returned: 0 in 0.520s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:02 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 1G Jul 23 10:25:02 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:03 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 1G" returned: 0 in 0.618s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bc05ab-d605-440f-acb5-83c472a99168 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:03 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bc05ab-d605-440f-acb5-83c472a99168 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 Jul 23 10:25:03 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-04906cf8-1b6f-4afa-8320-dd7c3895d44c req-16b2dde8-64b7-4dae-bf50-eee2b59b255a tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:03 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bc05ab-d605-440f-acb5-83c472a99168 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6" returned: 0 in 0.359s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:03 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 is being set with open permissions: ugo+rw Jul 23 10:25:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:03 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 Jul 23 10:25:03 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:03 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6" returned: 0 in 0.277s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:03 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.info Jul 23 10:25:03 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:04 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.info" returned: 0 in 0.286s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:04 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.info is being set with open permissions: ugo+rw Jul 23 10:25:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:04 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.info Jul 23 10:25:04 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:04 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.info" returned: 0 in 0.297s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.461s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-04906cf8-1b6f-4afa-8320-dd7c3895d44c req-16b2dde8-64b7-4dae-bf50-eee2b59b255a tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.145s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-04906cf8-1b6f-4afa-8320-dd7c3895d44c req-16b2dde8-64b7-4dae-bf50-eee2b59b255a tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c8bca1da-b1a9-484d-8a5e-946a9ebe1971 tempest-VolumesExtendTest-612644769 None] Create snapshot completed successfully Jul 23 10:25:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-04906cf8-1b6f-4afa-8320-dd7c3895d44c req-16b2dde8-64b7-4dae-bf50-eee2b59b255a tempest-AttachVolumeTestJSON-1879274770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50187fe8-d7c4-4dc1-a97d-fb70b36180f9', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:25:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-04906cf8-1b6f-4afa-8320-dd7c3895d44c req-16b2dde8-64b7-4dae-bf50-eee2b59b255a tempest-AttachVolumeTestJSON-1879274770 None] attachment_update completed successfully. Jul 23 10:25:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e2553543-2f08-4ed4-b139-82a35937900a tempest-VolumesExtendTest-612644769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e2553543-2f08-4ed4-b139-82a35937900a tempest-VolumesExtendTest-612644769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:05 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba63bdee-9c94-4e5f-9c14-821dce7547ff]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e2553543-2f08-4ed4-b139-82a35937900a tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:05 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 Jul 23 10:25:05 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:05 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e2553543-2f08-4ed4-b139-82a35937900a tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168" returned: 0 in 0.471s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e2553543-2f08-4ed4-b139-82a35937900a tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 2G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e2553543-2f08-4ed4-b139-82a35937900a tempest-VolumesExtendTest-612644769 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 2G" returned: 0 in 0.125s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e2553543-2f08-4ed4-b139-82a35937900a tempest-VolumesExtendTest-612644769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.661s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:06 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e2553543-2f08-4ed4-b139-82a35937900a tempest-VolumesExtendTest-612644769 None] Extend volume completed successfully. Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Acquiring lock "cinder-304c4e3a-9d57-43b1-bec5-2af2d5caefd6-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Lock "cinder-304c4e3a-9d57-43b1-bec5-2af2d5caefd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Acquiring lock "cinder-quobyte-84bc05ab-d605-440f-acb5-83c472a99168" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Lock "cinder-quobyte-84bc05ab-d605-440f-acb5-83c472a99168" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Acquiring lock "cinder-quobyte-304c4e3a-9d57-43b1-bec5-2af2d5caefd6" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Lock "cinder-quobyte-304c4e3a-9d57-43b1-bec5-2af2d5caefd6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Deleting offline snapshot 304c4e3a-9d57-43b1-bec5-2af2d5caefd6 of volume 84bc05ab-d605-440f-acb5-83c472a99168 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] snapshot_file for this snap is: volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eedec3-de24-4836-9633-ec8addd9dee7]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:07 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 Jul 23 10:25:07 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:07 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6" returned: 0 in 0.444s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84bc05ab-d605-440f-acb5-83c472a99168(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:25:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77f4ece-9cf6-4573-b11c-4a4eb01172bd]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:07 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 Jul 23 10:25:07 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:07 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168" returned: 0 in 0.388s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:07 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 Jul 23 10:25:07 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:08 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6" returned: 0 in 0.406s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:08 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6 Jul 23 10:25:08 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:08 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168.304c4e3a-9d57-43b1-bec5-2af2d5caefd6" returned: 0 in 0.302s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Lock "cinder-quobyte-304c4e3a-9d57-43b1-bec5-2af2d5caefd6" released by "_delete_snapshot" :: held 1.709s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Lock "cinder-quobyte-84bc05ab-d605-440f-acb5-83c472a99168" released by "delete_snapshot" :: held 1.749s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:08 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Created reservations ['df1390a8-629c-430f-8c2d-1b0922d3a5d5', '99bdc77d-01fa-45ee-be66-e5adc15f9bb5', '043850ca-3569-40a9-86af-dba0ea1e4998', 'bdff457e-dc3d-47bb-9856-e66c1aae4595'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:25:08 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Delete snapshot completed successfully. Jul 23 10:25:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0928f87e-c499-4230-91f5-4def2154439c tempest-VolumesExtendTest-612644769 None] Lock "cinder-304c4e3a-9d57-43b1-bec5-2af2d5caefd6-delete_snapshot" released by "delete_snapshot" :: held 1.969s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Acquiring lock "cinder-84bc05ab-d605-440f-acb5-83c472a99168-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Lock "cinder-84bc05ab-d605-440f-acb5-83c472a99168-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Acquiring lock "cinder-quobyte-84bc05ab-d605-440f-acb5-83c472a99168" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Lock "cinder-quobyte-84bc05ab-d605-440f-acb5-83c472a99168" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:09 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a4adf7-037a-406e-9334-9f174401cd0b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:09 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 Jul 23 10:25:09 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:09 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168" returned: 0 in 0.717s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:10 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168 Jul 23 10:25:10 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:10 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84bc05ab-d605-440f-acb5-83c472a99168" returned: 0 in 0.408s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Lock "cinder-quobyte-84bc05ab-d605-440f-acb5-83c472a99168" released by "delete_volume" :: held 1.199s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Created reservations ['1d07f23f-ba06-47d8-ae1b-624e174853f3', 'be139d46-67bc-4087-8719-7c3a55542422', '4b8dfde5-85e8-4bde-805f-8542c621e4d8', '2d3361fa-9cbe-43a1-ab4f-383e6e36886b'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:10 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:25:10 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:10 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.261s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:25:10 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Deleted volume successfully. Jul 23 10:25:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6aafd7ed-c3fc-418d-a7c3-939dffd11fca tempest-VolumesExtendTest-612644769 None] Lock "cinder-84bc05ab-d605-440f-acb5-83c472a99168-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Flow 'volume_create_manager' (71d429c9-8eaa-4138-b73e-4ea9e241a1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a756a2-148c-4072-b823-a6ecfc4b2c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a756a2-148c-4072-b823-a6ecfc4b2c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1426044639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da1c68c-0585-4d78-a1fd-401cd4a863f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='408ccf259d5d46718e89865070fe2197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:15Z,use_quota=True,user_id='a2c639a8c5ac4c14aa36c382d3fd634b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d73f06-1728-4e48-b64a-afb61f00dc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d73f06-1728-4e48-b64a-afb61f00dc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72137467-3e0c-4c00-bf78-ea5ebdab8c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72137467-3e0c-4c00-bf78-ea5ebdab8c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da1c68c-0585-4d78-a1fd-401cd4a863f0', 'volume_name': 'volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cc46cf-fa64-4d74-ab70-454cebb00d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cc46cf-fa64-4d74-ab70-454cebb00d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c44dba-e131-4843-a1ef-94ac3186797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:15 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Volume 9da1c68c-0585-4d78-a1fd-401cd4a863f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0', 'volume_size': 1} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1426044639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da1c68c-0585-4d78-a1fd-401cd4a863f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='408ccf259d5d46718e89865070fe2197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:15Z,use_quota=True,user_id='a2c639a8c5ac4c14aa36c382d3fd634b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Creating volume 9da1c68c-0585-4d78-a1fd-401cd4a863f0 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:25:15 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:15 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0 1073741824 Jul 23 10:25:15 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:15 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0 1073741824" returned: 0 in 0.470s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:15 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0 Jul 23 10:25:15 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:16 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0" returned: 0 in 0.265s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:25:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c44dba-e131-4843-a1ef-94ac3186797e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf2f2ad-540a-4f90-a47a-e80860c75c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:16 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Volume volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0 (9da1c68c-0585-4d78-a1fd-401cd4a863f0): created successfully Jul 23 10:25:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf2f2ad-540a-4f90-a47a-e80860c75c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Flow 'volume_create_manager' (71d429c9-8eaa-4138-b73e-4ea9e241a1c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:16 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-19f4c831-3352-491c-9799-81114345cb97 tempest-VolumesListTestJSON-977634315 None] Created volume successfully. Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Flow 'volume_create_manager' (95b04ca9-9160-4468-b1ca-50ff431db8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08d153c-a8ba-443a-9a8e-04acd6a33186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08d153c-a8ba-443a-9a8e-04acd6a33186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1575562251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f1083d-4d53-4e52-82aa-2ea957ca6e02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='408ccf259d5d46718e89865070fe2197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:18Z,use_quota=True,user_id='a2c639a8c5ac4c14aa36c382d3fd634b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f05a4b-ebf4-4f91-b2cf-1646dffcbd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f05a4b-ebf4-4f91-b2cf-1646dffcbd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a809ff9-956e-4535-a297-7c97495153ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a809ff9-956e-4535-a297-7c97495153ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f1083d-4d53-4e52-82aa-2ea957ca6e02', 'volume_name': 'volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80606425-67a6-44ad-99ae-ba1b16e00a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80606425-67a6-44ad-99ae-ba1b16e00a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfcb047-5c7f-4a2d-a5cc-b726ec064dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:18 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Volume 41f1083d-4d53-4e52-82aa-2ea957ca6e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02', 'volume_size': 1} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1575562251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f1083d-4d53-4e52-82aa-2ea957ca6e02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='408ccf259d5d46718e89865070fe2197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:18Z,use_quota=True,user_id='a2c639a8c5ac4c14aa36c382d3fd634b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Creating volume 41f1083d-4d53-4e52-82aa-2ea957ca6e02 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:25:18 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:18 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02 1073741824 Jul 23 10:25:18 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:18 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02 1073741824" returned: 0 in 0.524s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:18 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02 Jul 23 10:25:18 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:19 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02" returned: 0 in 0.328s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:25:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfcb047-5c7f-4a2d-a5cc-b726ec064dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfb028c-1ef5-4ab7-a3ef-663551a37f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:19 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Volume volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02 (41f1083d-4d53-4e52-82aa-2ea957ca6e02): created successfully Jul 23 10:25:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfb028c-1ef5-4ab7-a3ef-663551a37f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Flow 'volume_create_manager' (95b04ca9-9160-4468-b1ca-50ff431db8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fda83c15-985c-4c3e-b26e-23dfab237e6e tempest-VolumesListTestJSON-977634315 None] Created volume successfully. Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Flow 'volume_create_manager' (15450c4c-cc7f-4d69-8031-32cc0742e5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b10d5c9-9726-44d0-be59-bd330b01e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b10d5c9-9726-44d0-be59-bd330b01e96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1060540646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b4cb43-986a-4c1c-b22c-f8fc1bae493c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='408ccf259d5d46718e89865070fe2197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:21Z,use_quota=True,user_id='a2c639a8c5ac4c14aa36c382d3fd634b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a3ddac-6f1f-466e-9f14-a1cae3e723f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a3ddac-6f1f-466e-9f14-a1cae3e723f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6867c83d-c263-43b5-b636-7cc3b72f544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6867c83d-c263-43b5-b636-7cc3b72f544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b4cb43-986a-4c1c-b22c-f8fc1bae493c', 'volume_name': 'volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be68785d-ea3d-43b7-99fe-29cde05e0f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be68785d-ea3d-43b7-99fe-29cde05e0f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6d9ff1-a449-4cb2-8c9d-0648d8c14524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:21 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Volume 47b4cb43-986a-4c1c-b22c-f8fc1bae493c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c', 'volume_size': 1} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1060540646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b4cb43-986a-4c1c-b22c-f8fc1bae493c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='408ccf259d5d46718e89865070fe2197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:21Z,use_quota=True,user_id='a2c639a8c5ac4c14aa36c382d3fd634b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Creating volume 47b4cb43-986a-4c1c-b22c-f8fc1bae493c {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:25:21 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:25:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:21 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c 1073741824 Jul 23 10:25:21 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:22 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c 1073741824" returned: 0 in 1.121s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:22 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=82,cinder:UPDATE=94,cinder:INSERT=29,cinder:DELETE=10 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:25:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:22 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c Jul 23 10:25:22 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:22 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c" returned: 0 in 0.394s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:25:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6d9ff1-a449-4cb2-8c9d-0648d8c14524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8112fbc-e8bd-415b-85cb-bec212a3a4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:22 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Volume volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c (47b4cb43-986a-4c1c-b22c-f8fc1bae493c): created successfully Jul 23 10:25:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8112fbc-e8bd-415b-85cb-bec212a3a4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Flow 'volume_create_manager' (15450c4c-cc7f-4d69-8031-32cc0742e5f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:23 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-daa9930a-75f2-43a0-80e4-e0b17fa69424 tempest-VolumesListTestJSON-977634315 None] Created volume successfully. Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Acquiring lock "cinder-2b551acc-f6c3-4adc-8916-1102cac2e6bf-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Lock "cinder-2b551acc-f6c3-4adc-8916-1102cac2e6bf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Acquiring lock "cinder-quobyte-2b551acc-f6c3-4adc-8916-1102cac2e6bf" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Lock "cinder-quobyte-2b551acc-f6c3-4adc-8916-1102cac2e6bf" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[55899e9e-c440-4789-ae48-a200da019040]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Acquiring lock "cinder-47b4cb43-986a-4c1c-b22c-f8fc1bae493c-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Lock "cinder-47b4cb43-986a-4c1c-b22c-f8fc1bae493c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Acquiring lock "cinder-quobyte-47b4cb43-986a-4c1c-b22c-f8fc1bae493c" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Lock "cinder-quobyte-47b4cb43-986a-4c1c-b22c-f8fc1bae493c" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[591cfeda-a06b-479a-9762-87c4ff5ec5a0]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:27 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf Jul 23 10:25:27 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:27 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c Jul 23 10:25:27 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:27 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf" returned: 0 in 0.404s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:27 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf Jul 23 10:25:27 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:27 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c" returned: 0 in 0.442s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:27 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c Jul 23 10:25:27 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:27 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2b551acc-f6c3-4adc-8916-1102cac2e6bf" returned: 0 in 0.262s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Lock "cinder-quobyte-2b551acc-f6c3-4adc-8916-1102cac2e6bf" released by "delete_volume" :: held 0.721s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Created reservations ['0447268d-2813-4b83-a0bd-330c0fd83787', '577b3979-ae65-43b9-8369-de4858aa1a4e', '144f46a0-743e-4820-b24b-c54d247c7c63', '044bde77-6273-4078-aed6-3996eddd75e1'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:28 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-47b4cb43-986a-4c1c-b22c-f8fc1bae493c" returned: 0 in 0.287s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:28 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:25:28 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Lock "cinder-quobyte-47b4cb43-986a-4c1c-b22c-f8fc1bae493c" released by "delete_volume" :: held 0.775s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Created reservations ['19825fcb-86f7-4ebe-83d2-d859405e71f9', '9755b765-302c-4977-bc05-d241ccb3e8a5', '92fc9d2a-7f59-4092-a010-a53f566d9644', 'a0ce7fba-7a22-4049-bce0-306579777362'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:28 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:25:28 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:28 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.289s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:25:28 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Deleted volume successfully. Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a39bc9bb-3620-4621-aaba-12c616ac2489 tempest-AttachVolumeShelveTestJSON-1442305901 None] Lock "cinder-2b551acc-f6c3-4adc-8916-1102cac2e6bf-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Acquiring lock "cinder-41f1083d-4d53-4e52-82aa-2ea957ca6e02-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Lock "cinder-41f1083d-4d53-4e52-82aa-2ea957ca6e02-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:28 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.351s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Acquiring lock "cinder-quobyte-41f1083d-4d53-4e52-82aa-2ea957ca6e02" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:28 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Deleted volume successfully. Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Lock "cinder-quobyte-41f1083d-4d53-4e52-82aa-2ea957ca6e02" acquired by "delete_volume" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d019f9ea-d022-4215-87cf-a125eec22eb5 tempest-VolumesListTestJSON-977634315 None] Lock "cinder-47b4cb43-986a-4c1c-b22c-f8fc1bae493c-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37f1ecf-c64e-4cc0-8d42-1719a69e985d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:28 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02 Jul 23 10:25:28 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:29 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02" returned: 0 in 0.445s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:29 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02 Jul 23 10:25:29 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:29 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-41f1083d-4d53-4e52-82aa-2ea957ca6e02" returned: 0 in 0.285s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Lock "cinder-quobyte-41f1083d-4d53-4e52-82aa-2ea957ca6e02" released by "delete_volume" :: held 0.794s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Created reservations ['28956d31-2967-40f7-9da4-c375d18cbd88', 'f4b424df-080f-44f5-9508-ee046f1ae7fc', '496ceb33-4289-490e-8337-6c6044844f36', '4ead460e-0b66-4fd9-aa50-0f508a2ea991'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:29 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:25:29 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:29 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Acquiring lock "cinder-9da1c68c-0585-4d78-a1fd-401cd4a863f0-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.299s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:25:29 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Deleted volume successfully. Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Lock "cinder-9da1c68c-0585-4d78-a1fd-401cd4a863f0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0ad6e20a-98c7-449b-a85e-d8ce9f2b6e6a tempest-VolumesListTestJSON-977634315 None] Lock "cinder-41f1083d-4d53-4e52-82aa-2ea957ca6e02-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Acquiring lock "cinder-quobyte-9da1c68c-0585-4d78-a1fd-401cd4a863f0" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Lock "cinder-quobyte-9da1c68c-0585-4d78-a1fd-401cd4a863f0" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:30 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d4156-f806-4c26-acbb-dc5a2d35565e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:30 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0 Jul 23 10:25:30 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:30 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0" returned: 0 in 0.537s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:30 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0 Jul 23 10:25:30 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:30 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9da1c68c-0585-4d78-a1fd-401cd4a863f0" returned: 0 in 0.291s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Lock "cinder-quobyte-9da1c68c-0585-4d78-a1fd-401cd4a863f0" released by "delete_volume" :: held 0.907s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:30 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Created reservations ['d525ba99-20b4-42aa-9015-d2dc60a72337', 'a6cb540e-cb58-4398-8b33-d5f6847d2e3a', 'b5bbee73-31ab-46ac-9405-56a57b57a8e3', '128b276b-0b71-4928-ab7c-5eae87238a34'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:25:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:31 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:25:31 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:31 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.263s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:31 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:25:31 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Deleted volume successfully. Jul 23 10:25:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d624677-8730-4c4e-bf0a-0011a2ea0e26 tempest-VolumesListTestJSON-977634315 None] Lock "cinder-9da1c68c-0585-4d78-a1fd-401cd4a863f0-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=109,cinder:SELECT=120,cinder:INSERT=27,cinder:DELETE=8 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Flow 'volume_create_manager' (8fa8af94-d264-4ab1-980e-c83f79fe7755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53d4f23-396a-4676-91a3-a2121e2a4e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53d4f23-396a-4676-91a3-a2121e2a4e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-718217932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcedda56-76a0-47f8-be89-7a6edf3a52a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929fbc8416394fff963d30b735fbb222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:37Z,use_quota=True,user_id='f4c99430137f4e53b7bfc065cf172e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c2693f-4e93-4002-b2a2-5427de8a8e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c2693f-4e93-4002-b2a2-5427de8a8e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168521a6-6706-42a5-ac26-fa417062e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168521a6-6706-42a5-ac26-fa417062e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcedda56-76a0-47f8-be89-7a6edf3a52a0', 'volume_name': 'volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edafe86a-8fd6-4bda-8069-f8f5e57ae752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edafe86a-8fd6-4bda-8069-f8f5e57ae752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d079e5-95ad-44a2-a9e1-65c3c68aa56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:36 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Volume bcedda56-76a0-47f8-be89-7a6edf3a52a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0', 'volume_size': 1} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-718217932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcedda56-76a0-47f8-be89-7a6edf3a52a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929fbc8416394fff963d30b735fbb222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:37Z,use_quota=True,user_id='f4c99430137f4e53b7bfc065cf172e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Creating volume bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:25:36 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:25:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:36 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 1073741824 Jul 23 10:25:36 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:37 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 1073741824" returned: 0 in 0.662s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:37 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 Jul 23 10:25:37 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:37 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0" returned: 0 in 0.331s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:25:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d079e5-95ad-44a2-a9e1-65c3c68aa56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5932f8d0-7b25-4af3-97e4-ae4628c48cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:37 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Volume volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 (bcedda56-76a0-47f8-be89-7a6edf3a52a0): created successfully Jul 23 10:25:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5932f8d0-7b25-4af3-97e4-ae4628c48cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Flow 'volume_create_manager' (8fa8af94-d264-4ab1-980e-c83f79fe7755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:37 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-76b7b201-d1e0-4b2c-a5ae-e8e69657d163 tempest-VolumesSnapshotListTestJSON-1936583015 None] Created volume successfully. Jul 23 10:25:38 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-3fbc65f0-05ab-4d70-9aa2-cd4a206fdaed req-e2a08dba-9528-4810-ae3d-66bc8201e3ab tempest-AttachVolumeTestJSON-1879274770 None] Terminate volume connection completed successfully. Jul 23 10:25:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-3fbc65f0-05ab-4d70-9aa2-cd4a206fdaed req-e2a08dba-9528-4810-ae3d-66bc8201e3ab tempest-AttachVolumeTestJSON-1879274770 None] Deleting attachment 50187fe8-d7c4-4dc1-a97d-fb70b36180f9. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:25:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:39 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] Creating offline snapshot 13522c41-03c4-47cd-95f9-70974a5f8211 of volume bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:25:39 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87da3e6-65e0-4b49-8e81-35efc29a6bee]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:39 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 Jul 23 10:25:39 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:39 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0" returned: 0 in 0.479s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:39 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 1G Jul 23 10:25:39 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:40 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 1G" returned: 0 in 0.482s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:40 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 Jul 23 10:25:40 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:40 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211" returned: 0 in 0.306s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:40 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 is being set with open permissions: ugo+rw Jul 23 10:25:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:40 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 Jul 23 10:25:40 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:40 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211" returned: 0 in 0.327s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:40 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.info Jul 23 10:25:40 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:41 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.info" returned: 0 in 0.322s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:41 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.info is being set with open permissions: ugo+rw Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:41 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.info Jul 23 10:25:41 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:41 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.info" returned: 0 in 0.410s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.456s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:41 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e3cfd608-8d05-4482-8be8-1ce77c41cb9c tempest-VolumesSnapshotListTestJSON-1936583015 None] Create snapshot completed successfully Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Flow 'volume_create_manager' (92403b17-5a60-420c-a7ab-207c031ada0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2537bc-9268-4926-925e-f5659c3e6c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2537bc-9268-4926-925e-f5659c3e6c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-933056671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39187049-8f93-42e7-875b-2b150dd3daca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bfc7b99690b4711ad444095df1f47a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:42Z,use_quota=True,user_id='31b512fae21641c1bbc71ebbc77753d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7c2a61-cdd0-4bc6-9ba3-16156e7020c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7c2a61-cdd0-4bc6-9ba3-16156e7020c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3352fa-d167-42aa-87cb-0d7314630de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3352fa-d167-42aa-87cb-0d7314630de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39187049-8f93-42e7-875b-2b150dd3daca', 'volume_name': 'volume-39187049-8f93-42e7-875b-2b150dd3daca', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040d447e-5484-478a-970f-b192594bd654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040d447e-5484-478a-970f-b192594bd654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffef3857-51fc-4b30-9404-0f685b4a5d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:41 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Volume 39187049-8f93-42e7-875b-2b150dd3daca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39187049-8f93-42e7-875b-2b150dd3daca', 'volume_size': 1} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-933056671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39187049-8f93-42e7-875b-2b150dd3daca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bfc7b99690b4711ad444095df1f47a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:25:42Z,use_quota=True,user_id='31b512fae21641c1bbc71ebbc77753d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Creating volume 39187049-8f93-42e7-875b-2b150dd3daca {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:25:41 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:25:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:41 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca 1073741824 Jul 23 10:25:41 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:42 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca 1073741824" returned: 0 in 0.672s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:42 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca Jul 23 10:25:42 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:43 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca" returned: 0 in 0.512s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.616s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] Creating offline snapshot 163b2877-dc04-435d-b03c-3fef9d550c49 of volume bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffef3857-51fc-4b30-9404-0f685b4a5d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39187049-8f93-42e7-875b-2b150dd3daca', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d950dc73-724e-4f52-a085-b6e34c1e4ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f60733-a736-40db-a064-2003c7869ca7]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:43 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Volume volume-39187049-8f93-42e7-875b-2b150dd3daca (39187049-8f93-42e7-875b-2b150dd3daca): created successfully Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d950dc73-724e-4f52-a085-b6e34c1e4ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Flow 'volume_create_manager' (92403b17-5a60-420c-a7ab-207c031ada0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:25:43 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-acb4927c-0b60-4113-9a4b-07c43c341703 tempest-TestStampPattern-342022455 None] Created volume successfully. Jul 23 10:25:43 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 Jul 23 10:25:43 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:43 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211" returned: 0 in 0.499s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:25:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:43 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 1G Jul 23 10:25:43 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:44 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 1G" returned: 0 in 0.772s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:44 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 Jul 23 10:25:44 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:45 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49" returned: 0 in 0.530s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:45 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 is being set with open permissions: ugo+rw Jul 23 10:25:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:45 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 Jul 23 10:25:45 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:45 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49" returned: 0 in 0.625s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:45 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-925eb723-3db1-4a3e-a915-ef61c9919828 tempest-VolumesSnapshotListTestJSON-1936583015 None] Create snapshot completed successfully Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:46 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:25:46 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:46 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.399s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:25:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:25:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:25:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:25:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] Creating offline snapshot 10d61a47-5a11-4277-ad31-23f39489580f of volume bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:25:47 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[87003bf7-0012-4176-86df-c503d8e78198]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:47 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 Jul 23 10:25:47 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:48 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49" returned: 0 in 0.692s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:25:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:48 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f 1G Jul 23 10:25:48 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:49 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f 1G" returned: 0 in 1.125s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:49 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f Jul 23 10:25:49 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:50 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f" returned: 0 in 0.573s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:50 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f is being set with open permissions: ugo+rw Jul 23 10:25:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:50 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f Jul 23 10:25:50 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:50 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f" returned: 0 in 0.469s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.116s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:25:50 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ce3f4ae2-2e05-46ae-b36e-4fac020cef3f tempest-VolumesSnapshotListTestJSON-1936583015 None] Create snapshot completed successfully Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "cinder-10d61a47-5a11-4277-ad31-23f39489580f-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-10d61a47-5a11-4277-ad31-23f39489580f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "cinder-quobyte-10d61a47-5a11-4277-ad31-23f39489580f" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-10d61a47-5a11-4277-ad31-23f39489580f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Deleting offline snapshot 10d61a47-5a11-4277-ad31-23f39489580f of volume bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] snapshot_file for this snap is: volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0baa651-5d8d-4355-a3da-25112692bae6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:53 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f Jul 23 10:25:53 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:53 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f" returned: 0 in 0.588s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2d118-f0f3-4303-90fb-978345cdc521]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:54 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 Jul 23 10:25:54 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:54 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49" returned: 0 in 0.520s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:25:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:54 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f Jul 23 10:25:54 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:55 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f" returned: 0 in 0.736s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:55 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f Jul 23 10:25:55 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:55 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.10d61a47-5a11-4277-ad31-23f39489580f" returned: 0 in 0.678s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-10d61a47-5a11-4277-ad31-23f39489580f" released by "_delete_snapshot" :: held 2.706s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" released by "delete_snapshot" :: held 2.746s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Created reservations ['8d0f8b0f-256c-477e-b149-2d900ddf38c8', '70133e2e-7921-4a89-95e7-2044d70f2f7e', '55553cb4-aeaa-4dcd-8364-17f372ac38af', '2ae20d5b-af11-4650-929c-f0171a837a6d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:25:56 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Delete snapshot completed successfully. Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0cc7162c-c7c0-47d0-9560-4b6ce988ab86 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-10d61a47-5a11-4277-ad31-23f39489580f-delete_snapshot" released by "delete_snapshot" :: held 3.079s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "cinder-163b2877-dc04-435d-b03c-3fef9d550c49-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-163b2877-dc04-435d-b03c-3fef9d550c49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" acquired by "delete_snapshot" :: waited 0.055s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "cinder-quobyte-163b2877-dc04-435d-b03c-3fef9d550c49" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-163b2877-dc04-435d-b03c-3fef9d550c49" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Deleting offline snapshot 163b2877-dc04-435d-b03c-3fef9d550c49 of volume bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] snapshot_file for this snap is: volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0bd8db-1208-4720-b087-d059735dc8c5]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:57 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 Jul 23 10:25:57 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:57 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49" returned: 0 in 0.833s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:25:57 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb7e1eb-b050-4e7b-adb2-3da3a55bb6a1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:25:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:57 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 Jul 23 10:25:57 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:58 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211" returned: 0 in 0.929s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:25:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:58 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 Jul 23 10:25:58 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:25:59 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 23 10:25:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49" returned: 0 in 1.181s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:25:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:25:59 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49 Jul 23 10:25:59 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:00 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.163b2877-dc04-435d-b03c-3fef9d550c49" returned: 0 in 0.624s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-163b2877-dc04-435d-b03c-3fef9d550c49" released by "_delete_snapshot" :: held 3.795s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:26:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" released by "delete_snapshot" :: held 3.893s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:26:00 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Created reservations ['cfd2104f-9b7e-4268-b0fd-ded1705371ee', 'cb702ad1-3d1b-453c-851e-2ca99afbb4ca', '33ba426b-2ad7-41e7-bcbb-f5628ea89988', '44b7414c-e728-4d32-bf16-86136ae166f3'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:26:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Delete snapshot completed successfully. Jul 23 10:26:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3117cf51-a833-4247-89f5-8b726af3506e tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-163b2877-dc04-435d-b03c-3fef9d550c49-delete_snapshot" released by "delete_snapshot" :: held 4.141s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "cinder-13522c41-03c4-47cd-95f9-70974a5f8211-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-13522c41-03c4-47cd-95f9-70974a5f8211-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "cinder-quobyte-13522c41-03c4-47cd-95f9-70974a5f8211" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-13522c41-03c4-47cd-95f9-70974a5f8211" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Deleting offline snapshot 13522c41-03c4-47cd-95f9-70974a5f8211 of volume bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] snapshot_file for this snap is: volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaac682-79de-4caa-8247-6b787d884047]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:01 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 Jul 23 10:26:01 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:01 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211" returned: 0 in 0.464s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8309867f-6bcb-401d-aa66-3f123b57fdee]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:26:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:01 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 Jul 23 10:26:01 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:02 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0" returned: 0 in 0.511s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:02 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 Jul 23 10:26:02 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:03 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211" returned: 0 in 0.881s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:03 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211 Jul 23 10:26:03 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:03 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0.13522c41-03c4-47cd-95f9-70974a5f8211" returned: 0 in 0.734s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-13522c41-03c4-47cd-95f9-70974a5f8211" released by "_delete_snapshot" :: held 2.757s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:26:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" released by "delete_snapshot" :: held 2.796s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:26:04 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Created reservations ['202689a9-f37a-4753-89e8-a811f8c1ba35', '837570e9-f5b3-4ee1-9fec-8d2da7b0d6b0', '82edd8d9-dcf4-4e3f-ac8f-cdd3d4307ea3', '3f11e979-766e-450d-b5b6-baf292537c42'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:26:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Delete snapshot completed successfully. Jul 23 10:26:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7b79306f-1dd8-4ff4-a16b-42c66f2a4eea tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-13522c41-03c4-47cd-95f9-70974a5f8211-delete_snapshot" released by "delete_snapshot" :: held 3.035s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:26:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "cinder-bcedda56-76a0-47f8-be89-7a6edf3a52a0-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:26:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-bcedda56-76a0-47f8-be89-7a6edf3a52a0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:26:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:26:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:26:04 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d297d65-df8a-4ed6-8bc3-98a48b200fa7]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:26:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:04 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 Jul 23 10:26:04 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:05 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0" returned: 0 in 0.507s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:05 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0 Jul 23 10:26:05 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:05 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bcedda56-76a0-47f8-be89-7a6edf3a52a0" returned: 0 in 0.295s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-quobyte-bcedda56-76a0-47f8-be89-7a6edf3a52a0" released by "delete_volume" :: held 0.923s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:26:05 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Created reservations ['edc027b2-e31c-41bb-bf3c-290d254fa693', '94440c20-47ef-422c-bdb9-1b0d52b3d754', '86c99f1f-0205-4602-8c9c-8d906559b6e4', '7bdeb6df-f6b3-4584-aa3e-68642212c40a'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:26:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:26:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:26:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:05 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:26:05 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:06 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.297s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:06 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:26:06 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Deleted volume successfully. Jul 23 10:26:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2592c675-cfde-4f27-bf25-35b99816c9a5 tempest-VolumesSnapshotListTestJSON-1936583015 None] Lock "cinder-bcedda56-76a0-47f8-be89-7a6edf3a52a0-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:26:15 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=31,cinder:INSERT=11,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:26:16 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=77,cinder:SELECT=50,cinder:INSERT=18,cinder:DELETE=5 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:26:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-e097d3a0-63a5-4d6f-ae9a-721d751bd70e req-f1070d62-9669-4e2b-a475-5bcfbc21fd26 tempest-TestStampPattern-342022455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-e097d3a0-63a5-4d6f-ae9a-721d751bd70e req-f1070d62-9669-4e2b-a475-5bcfbc21fd26 tempest-TestStampPattern-342022455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-e097d3a0-63a5-4d6f-ae9a-721d751bd70e req-f1070d62-9669-4e2b-a475-5bcfbc21fd26 tempest-TestStampPattern-342022455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-e097d3a0-63a5-4d6f-ae9a-721d751bd70e req-f1070d62-9669-4e2b-a475-5bcfbc21fd26 tempest-TestStampPattern-342022455 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-39187049-8f93-42e7-875b-2b150dd3daca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45ade3e2-7490-4151-9bc9-d61cf226453f', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:26:28 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-e097d3a0-63a5-4d6f-ae9a-721d751bd70e req-f1070d62-9669-4e2b-a475-5bcfbc21fd26 tempest-TestStampPattern-342022455 None] attachment_update completed successfully. Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Flow 'volume_create_manager' (62d36667-286d-4b04-aec2-ef87891fe1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3402cd-4f38-4db0-8918-cafcf2b3b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3402cd-4f38-4db0-8918-cafcf2b3b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-451934728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b325613-835e-441d-b911-085f8ee5a403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2758e78e00c943daba79fdfababca49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:26:29Z,use_quota=True,user_id='85ebb403d3234076aa99e0155c2b0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af2505b-28a1-4535-9e3c-273501e18f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af2505b-28a1-4535-9e3c-273501e18f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6a728b-edf0-4a82-91b0-2740db6089dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6a728b-edf0-4a82-91b0-2740db6089dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b325613-835e-441d-b911-085f8ee5a403', 'volume_name': 'volume-8b325613-835e-441d-b911-085f8ee5a403', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf15b216-f6b5-4813-8421-7818b3ac712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf15b216-f6b5-4813-8421-7818b3ac712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2111657c-49f9-493e-9f07-fd5ac5ff3998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:29 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Volume 8b325613-835e-441d-b911-085f8ee5a403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b325613-835e-441d-b911-085f8ee5a403', 'volume_size': 1} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-451934728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b325613-835e-441d-b911-085f8ee5a403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2758e78e00c943daba79fdfababca49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:26:29Z,use_quota=True,user_id='85ebb403d3234076aa99e0155c2b0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Creating volume 8b325613-835e-441d-b911-085f8ee5a403 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:26:29 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:26:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:29 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403 1073741824 Jul 23 10:26:29 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:30 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403 1073741824" returned: 0 in 1.070s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:30 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403 Jul 23 10:26:30 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:30 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403" returned: 0 in 0.401s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:26:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2111657c-49f9-493e-9f07-fd5ac5ff3998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b325613-835e-441d-b911-085f8ee5a403', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe2f3ad-c9d2-44d3-865b-e7ff878167b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:30 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Volume volume-8b325613-835e-441d-b911-085f8ee5a403 (8b325613-835e-441d-b911-085f8ee5a403): created successfully Jul 23 10:26:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe2f3ad-c9d2-44d3-865b-e7ff878167b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Flow 'volume_create_manager' (62d36667-286d-4b04-aec2-ef87891fe1ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:26:30 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b114ab7e-fa8c-4b19-b124-35353f69ca08 tempest-AttachVolumeNegativeTest-1247823510 None] Created volume successfully. Jul 23 10:26:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-05d6369d-51cb-4d17-aeff-b208de163ce9 req-acd7d125-7c27-4f6d-8bb8-df45432acc43 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-05d6369d-51cb-4d17-aeff-b208de163ce9 req-acd7d125-7c27-4f6d-8bb8-df45432acc43 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-05d6369d-51cb-4d17-aeff-b208de163ce9 req-acd7d125-7c27-4f6d-8bb8-df45432acc43 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-05d6369d-51cb-4d17-aeff-b208de163ce9 req-acd7d125-7c27-4f6d-8bb8-df45432acc43 tempest-AttachVolumeNegativeTest-1247823510 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-8b325613-835e-441d-b911-085f8ee5a403', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13da6f76-6e3a-4ba6-89d8-a7d88455412a', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:26:32 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-05d6369d-51cb-4d17-aeff-b208de163ce9 req-acd7d125-7c27-4f6d-8bb8-df45432acc43 tempest-AttachVolumeNegativeTest-1247823510 None] attachment_update completed successfully. Jul 23 10:26:35 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-e2464c64-1d91-4a9a-881b-27224d324267 req-f4d3e84a-9776-439c-bc26-d60a758f3d1a tempest-TestStampPattern-342022455 None] Terminate volume connection completed successfully. Jul 23 10:26:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-e2464c64-1d91-4a9a-881b-27224d324267 req-f4d3e84a-9776-439c-bc26-d60a758f3d1a tempest-TestStampPattern-342022455 None] Deleting attachment 45ade3e2-7490-4151-9bc9-d61cf226453f. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:26:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] Creating offline snapshot bf42c26b-8b72-4cd8-8973-bd1db158cbd4 of volume 39187049-8f93-42e7-875b-2b150dd3daca {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:26:36 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[21482855-65c2-4036-a8c5-2cc77ebc085a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:26:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:36 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca Jul 23 10:26:36 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:37 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca" returned: 0 in 0.678s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:37 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 1G Jul 23 10:26:37 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:38 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 1G" returned: 0 in 0.632s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39187049-8f93-42e7-875b-2b150dd3daca -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:38 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39187049-8f93-42e7-875b-2b150dd3daca -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 Jul 23 10:26:38 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:38 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39187049-8f93-42e7-875b-2b150dd3daca -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4" returned: 0 in 0.418s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:38 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 is being set with open permissions: ugo+rw Jul 23 10:26:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:38 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 Jul 23 10:26:38 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:38 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4" returned: 0 in 0.321s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:38 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.info Jul 23 10:26:38 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:39 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.info" returned: 0 in 0.462s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:39 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.info is being set with open permissions: ugo+rw Jul 23 10:26:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:39 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.info Jul 23 10:26:39 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:39 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.info" returned: 0 in 0.409s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.135s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:39 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-be7a717e-b113-48bb-a926-a542d3baad9b tempest-TestStampPattern-342022455 None] Create snapshot completed successfully Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Flow 'volume_create_manager' (8d2136f4-7d51-4249-bce8-95fef2d82115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da8bbc2-f8f1-4bac-8aa0-d0f4f87ce48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da8bbc2-f8f1-4bac-8aa0-d0f4f87ce48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1276748223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec60abe-598c-441b-b34e-9065b56d6b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e96f8eaf6584a69a62d7a55cb9ad0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:26:46Z,use_quota=True,user_id='2d636f02e6cf45ccaa6353744769a445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9390022c-98d6-449f-beaf-cfc47591a1ea),volume_type_id=9390022c-98d6-449f-beaf-cfc47591a1ea)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c993409-bb2e-47e3-9a7a-b8f7ae8b74af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c993409-bb2e-47e3-9a7a-b8f7ae8b74af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2fe2429-e45a-4166-bfca-4bd8bb2c8abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2fe2429-e45a-4166-bfca-4bd8bb2c8abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec60abe-598c-441b-b34e-9065b56d6b49', 'volume_name': 'volume-0ec60abe-598c-441b-b34e-9065b56d6b49', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cea10ab-d9d7-48b2-abb2-7b54b015ebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cea10ab-d9d7-48b2-abb2-7b54b015ebea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1eed198-884a-4a2a-8d70-d08f8c79da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:45 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Volume 0ec60abe-598c-441b-b34e-9065b56d6b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec60abe-598c-441b-b34e-9065b56d6b49', 'volume_size': 1} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1276748223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec60abe-598c-441b-b34e-9065b56d6b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e96f8eaf6584a69a62d7a55cb9ad0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:26:46Z,use_quota=True,user_id='2d636f02e6cf45ccaa6353744769a445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9390022c-98d6-449f-beaf-cfc47591a1ea),volume_type_id=9390022c-98d6-449f-beaf-cfc47591a1ea)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Creating volume 0ec60abe-598c-441b-b34e-9065b56d6b49 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:26:45 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:26:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:45 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49 1073741824 Jul 23 10:26:45 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:46 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:26:46 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Flow 'volume_create_manager' (6d95f1bd-190c-4215-a9d2-93bd82a99ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2a2086-fdda-4047-83cd-22113ce10a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2a2086-fdda-4047-83cd-22113ce10a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2014911592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcc96c3-c913-4338-8721-ac49d4ec6245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e96f8eaf6584a69a62d7a55cb9ad0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:26:46Z,use_quota=True,user_id='2d636f02e6cf45ccaa6353744769a445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d8bf843-2fee-4d9e-9c82-72eabdbc75ba),volume_type_id=6d8bf843-2fee-4d9e-9c82-72eabdbc75ba)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0442404-93c9-4c05-871e-ad5ec93d4609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0442404-93c9-4c05-871e-ad5ec93d4609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7692e3a-1951-4947-948c-72900deb0390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7692e3a-1951-4947-948c-72900deb0390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebcc96c3-c913-4338-8721-ac49d4ec6245', 'volume_name': 'volume-ebcc96c3-c913-4338-8721-ac49d4ec6245', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c341e4-4d05-4155-bb5b-e22244f74963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c341e4-4d05-4155-bb5b-e22244f74963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376f37d5-600f-4839-90c1-bb57778c78da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:46 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Volume ebcc96c3-c913-4338-8721-ac49d4ec6245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebcc96c3-c913-4338-8721-ac49d4ec6245', 'volume_size': 1} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:46 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:46 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49 1073741824" returned: 0 in 0.760s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.372s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:26:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:46 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49 Jul 23 10:26:46 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:26:47 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Flow 'volume_create_manager' (317cbd29-17c1-498e-b5f6-651f7cfb747a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c0a9ef-988d-4555-ad77-f348c47b1381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49" returned: 0 in 0.726s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.938s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2014911592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcc96c3-c913-4338-8721-ac49d4ec6245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e96f8eaf6584a69a62d7a55cb9ad0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:26:46Z,use_quota=True,user_id='2d636f02e6cf45ccaa6353744769a445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d8bf843-2fee-4d9e-9c82-72eabdbc75ba),volume_type_id=6d8bf843-2fee-4d9e-9c82-72eabdbc75ba)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Creating volume ebcc96c3-c913-4338-8721-ac49d4ec6245 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:26:47 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1eed198-884a-4a2a-8d70-d08f8c79da2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec60abe-598c-441b-b34e-9065b56d6b49', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:47 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245 1073741824 Jul 23 10:26:47 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f5b7ad-308a-45be-9974-a9c61164378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c0a9ef-988d-4555-ad77-f348c47b1381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-493806225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11282999-ef7a-4b34-be43-d211a868b039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e96f8eaf6584a69a62d7a55cb9ad0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:26:47Z,use_quota=True,user_id='2d636f02e6cf45ccaa6353744769a445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c65c5ea-ee26-4e90-9c6e-6d649c2e9f77),volume_type_id=1c65c5ea-ee26-4e90-9c6e-6d649c2e9f77)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc6ac7a-b39e-46e3-b991-9ee77483c615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc6ac7a-b39e-46e3-b991-9ee77483c615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da449f76-0fba-4e7c-aa71-1484208f868c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.image.glance [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Creating Keystone auth plugin from conf {{(pid=88371) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 10:26:47 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Volume volume-0ec60abe-598c-441b-b34e-9065b56d6b49 (0ec60abe-598c-441b-b34e-9065b56d6b49): created successfully Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f5b7ad-308a-45be-9974-a9c61164378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Flow 'volume_create_manager' (8d2136f4-7d51-4249-bce8-95fef2d82115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:26:47 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b63252e3-b0ff-4cd8-9cb8-4c59222d82fb tempest-TestInstancesWithCinderVolumes-1443299191 None] Created volume successfully. Jul 23 10:26:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da449f76-0fba-4e7c-aa71-1484208f868c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '11282999-ef7a-4b34-be43-d211a868b039', 'volume_name': 'volume-11282999-ef7a-4b34-be43-d211a868b039', 'volume_size': 1, 'image_id': 'c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1576915030', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e96f8eaf6584a69a62d7a55cb9ad0ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'created_at': datetime.datetime(2026, 7, 23, 8, 26, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 26, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c60207cf-8db1-44c8-9d8f-0d950248bdb8/file', 'properties': {}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79dbc2e-3c5a-4f27-9230-fb8c8f2c3043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79dbc2e-3c5a-4f27-9230-fb8c8f2c3043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291acb7a-977f-4d6a-a2cd-8c4e6ea58323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:48 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Volume 11282999-ef7a-4b34-be43-d211a868b039: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-11282999-ef7a-4b34-be43-d211a868b039', 'volume_size': 1, 'image_id': 'c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1576915030', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e96f8eaf6584a69a62d7a55cb9ad0ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'created_at': datetime.datetime(2026, 7, 23, 8, 26, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 26, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c60207cf-8db1-44c8-9d8f-0d950248bdb8/file', 'properties': {}}, 'image_service': } Jul 23 10:26:48 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Trying to clone 11282999-ef7a-4b34-be43-d211a868b039 from image c60207cf-8db1-44c8-9d8f-0d950248bdb8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'metadata': {}}]). {{(pid=88371) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 10:26:48 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245 1073741824" returned: 0 in 1.111s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:48 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245 Jul 23 10:26:48 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:49 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245" returned: 0 in 0.713s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:26:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376f37d5-600f-4839-90c1-bb57778c78da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebcc96c3-c913-4338-8721-ac49d4ec6245', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77978b7-edd8-4090-98d3-2d4a6747366c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:49 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Volume volume-ebcc96c3-c913-4338-8721-ac49d4ec6245 (ebcc96c3-c913-4338-8721-ac49d4ec6245): created successfully Jul 23 10:26:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77978b7-edd8-4090-98d3-2d4a6747366c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Flow 'volume_create_manager' (6d95f1bd-190c-4215-a9d2-93bd82a99ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:26:49 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-59682d74-c3d6-4e84-a991-0a8195914328 tempest-TestInstancesWithCinderVolumes-1443299191 None] Created volume successfully. Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Flow 'volume_create_manager' (5e8b764d-354d-462e-adfb-d836fea4484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f9ebb9-5b17-44bc-895a-b33c057c7ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f9ebb9-5b17-44bc-895a-b33c057c7ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-869723241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6df2e3-b590-45dd-9360-13732f2257f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feed3a99ac4482ac0b9559176e6518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:26:52Z,use_quota=True,user_id='25d0291f31be4db290fb7587c73cf2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05923aa-870a-49c6-8e44-cd2726193d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05923aa-870a-49c6-8e44-cd2726193d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b4c66b-1f8f-424b-b171-5cc588fc2631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b4c66b-1f8f-424b-b171-5cc588fc2631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6df2e3-b590-45dd-9360-13732f2257f0', 'volume_name': 'volume-0d6df2e3-b590-45dd-9360-13732f2257f0', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff76bc6-2024-436c-b4a2-382a3a2fe6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff76bc6-2024-436c-b4a2-382a3a2fe6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949b78da-68b3-4797-9d2e-661cf8a5d7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:51 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Volume 0d6df2e3-b590-45dd-9360-13732f2257f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6df2e3-b590-45dd-9360-13732f2257f0', 'volume_size': 1} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-869723241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6df2e3-b590-45dd-9360-13732f2257f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feed3a99ac4482ac0b9559176e6518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:26:52Z,use_quota=True,user_id='25d0291f31be4db290fb7587c73cf2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Creating volume 0d6df2e3-b590-45dd-9360-13732f2257f0 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:26:51 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Flow 'volume_create_manager' (01006801-90bd-452a-b790-39c91d692830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:26:51 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0 1073741824 Jul 23 10:26:51 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93a482d-e621-4f18-94d7-b51fb578254c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93a482d-e621-4f18-94d7-b51fb578254c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-429838657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51291fd8-ecc4-4c28-8d60-f7d02e132721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bfc7b99690b4711ad444095df1f47a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf42c26b-8b72-4cd8-8973-bd1db158cbd4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:26:52Z,use_quota=True,user_id='31b512fae21641c1bbc71ebbc77753d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5dfd03b-da54-4455-89ad-f1fc0ffc6991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5dfd03b-da54-4455-89ad-f1fc0ffc6991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1492f9-1e92-4b42-99b6-ff20c0032b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1492f9-1e92-4b42-99b6-ff20c0032b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51291fd8-ecc4-4c28-8d60-f7d02e132721', 'volume_name': 'volume-51291fd8-ecc4-4c28-8d60-f7d02e132721', 'volume_size': 1, 'snapshot_id': 'bf42c26b-8b72-4cd8-8973-bd1db158cbd4'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac1511f-d387-4deb-a786-d3c9695c273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac1511f-d387-4deb-a786-d3c9695c273b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaf44ab-f34e-40a0-8a04-b899965b946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:52 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Volume 51291fd8-ecc4-4c28-8d60-f7d02e132721: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51291fd8-ecc4-4c28-8d60-f7d02e132721', 'volume_size': 1, 'snapshot_id': 'bf42c26b-8b72-4cd8-8973-bd1db158cbd4'} Jul 23 10:26:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:52 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0 1073741824" returned: 0 in 0.796s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:52 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0 Jul 23 10:26:52 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:53 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0" returned: 0 in 0.333s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.017s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Acquiring lock "cinder-quobyte-bf42c26b-8b72-4cd8-8973-bd1db158cbd4-51291fd8-ecc4-4c28-8d60-f7d02e132721" by "_create_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949b78da-68b3-4797-9d2e-661cf8a5d7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6df2e3-b590-45dd-9360-13732f2257f0', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aacb0dd-0a29-4f53-8163-9c25f0ba914d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-bf42c26b-8b72-4cd8-8973-bd1db158cbd4-51291fd8-ecc4-4c28-8d60-f7d02e132721" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Creating volume 51291fd8-ecc4-4c28-8d60-f7d02e132721 from snapshot bf42c26b-8b72-4cd8-8973-bd1db158cbd4 {{(pid=88371) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Acquiring lock "cinder-quobyte-51291fd8-ecc4-4c28-8d60-f7d02e132721" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:26:53 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Volume volume-0d6df2e3-b590-45dd-9360-13732f2257f0 (0d6df2e3-b590-45dd-9360-13732f2257f0): created successfully Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aacb0dd-0a29-4f53-8163-9c25f0ba914d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Flow 'volume_create_manager' (5e8b764d-354d-462e-adfb-d836fea4484d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-51291fd8-ecc4-4c28-8d60-f7d02e132721" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] snapshot: bf42c26b-8b72-4cd8-8973-bd1db158cbd4, volume: 51291fd8-ecc4-4c28-8d60-f7d02e132721, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:26:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c2239038-da95-4b66-a4ef-0f3a53eb21b7 tempest-AttachVolumeTestJSON-1879274770 None] Created volume successfully. Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f7d9a2-8412-491e-9819-ce9ec1822652]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:53 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 Jul 23 10:26:53 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:53 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4" returned: 0 in 0.512s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39187049-8f93-42e7-875b-2b150dd3daca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[172f65c0-4edc-4e55-9523-67dbf5576986]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:26:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:53 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca Jul 23 10:26:53 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:54 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca" returned: 0 in 0.652s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:54 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:26:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:54 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 Jul 23 10:26:54 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:54 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD, size 20.69 MB, duration 6.66 sec {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 10:26:54 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Image download 20.69 MB at 3.11 MB/s Jul 23 10:26:54 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b74b313-9614-454a-916a-6e6e2dcab410]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:26:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-57875b91-ffd0-4be6-80c9-27626fd923b8 req-6ddf1e76-934b-4361-a5ae-85f9d7a3dc58 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:26:55 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD Jul 23 10:26:55 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:56 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD" returned: 0 in 1.093s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:56 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Temporary image c60207cf-8db1-44c8-9d8f-0d950248bdb8 is fetched for user 2d636f02e6cf45ccaa6353744769a445. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 10:26:56 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a77bf5-f5ac-42ab-b612-b459033f0ef6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:26:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:26:57 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD Jul 23 10:26:57 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:26:58 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 23 10:26:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD" returned: 0 in 1.773s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:26:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:02 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721" returned: 0 in 8.474s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:02 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8603ec4d-199a-452b-92c1-b27f3d15b8b3]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:27:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:03 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca Jul 23 10:27:03 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:03 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca" returned: 0 in 0.724s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:03 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:27:03 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Converted 1024.00 MB image at 120.83 MB/s Jul 23 10:27:03 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 is being set with open permissions: ugo+rw Jul 23 10:27:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:03 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 Jul 23 10:27:03 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:04 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721" returned: 0 in 0.326s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-51291fd8-ecc4-4c28-8d60-f7d02e132721" released by "_copy_volume_from_snapshot" :: held 10.854s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-bf42c26b-8b72-4cd8-8973-bd1db158cbd4-51291fd8-ecc4-4c28-8d60-f7d02e132721" released by "_create_volume_from_snapshot" :: held 10.913s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.961s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-57875b91-ffd0-4be6-80c9-27626fd923b8 req-6ddf1e76-934b-4361-a5ae-85f9d7a3dc58 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.991s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-57875b91-ffd0-4be6-80c9-27626fd923b8 req-6ddf1e76-934b-4361-a5ae-85f9d7a3dc58 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.835s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-493806225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11282999-ef7a-4b34-be43-d211a868b039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e96f8eaf6584a69a62d7a55cb9ad0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:26:47Z,use_quota=True,user_id='2d636f02e6cf45ccaa6353744769a445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c65c5ea-ee26-4e90-9c6e-6d649c2e9f77),volume_type_id=1c65c5ea-ee26-4e90-9c6e-6d649c2e9f77)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Creating volume 11282999-ef7a-4b34-be43-d211a868b039 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:27:04 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:04 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 1073741824 Jul 23 10:27:04 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaf44ab-f34e-40a0-8a04-b899965b946e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51291fd8-ecc4-4c28-8d60-f7d02e132721', 'volume_size': 1, 'snapshot_id': 'bf42c26b-8b72-4cd8-8973-bd1db158cbd4'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bb449b-e21f-4a17-bdd8-3f902a5e5f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-57875b91-ffd0-4be6-80c9-27626fd923b8 req-6ddf1e76-934b-4361-a5ae-85f9d7a3dc58 tempest-AttachVolumeTestJSON-1879274770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-0d6df2e3-b590-45dd-9360-13732f2257f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d861568-bf7c-43df-a985-c0f78fef7e6e', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:27:04 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Volume volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 (51291fd8-ecc4-4c28-8d60-f7d02e132721): created successfully Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bb449b-e21f-4a17-bdd8-3f902a5e5f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Flow 'volume_create_manager' (01006801-90bd-452a-b790-39c91d692830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:27:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-57875b91-ffd0-4be6-80c9-27626fd923b8 req-6ddf1e76-934b-4361-a5ae-85f9d7a3dc58 tempest-AttachVolumeTestJSON-1879274770 None] attachment_update completed successfully. Jul 23 10:27:04 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 1073741824" returned: 0 in 0.544s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8b86665b-867e-4337-9e36-6e1d25f4fd52 tempest-TestStampPattern-342022455 None] Created volume successfully. Jul 23 10:27:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:04 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 Jul 23 10:27:04 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:05 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039" returned: 0 in 0.291s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:27:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:05 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Attempting download of c60207cf-8db1-44c8-9d8f-0d950248bdb8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'metadata': {}}])) to volume 11282999-ef7a-4b34-be43-d211a868b039. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 10:27:05 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a443f-dc9d-4a4c-8f1d-735d2d807bbf]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:27:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c60207cf-8db1-44c8-9d8f-0d950248bdb8_6xx0xiyk {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:05 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c60207cf-8db1-44c8-9d8f-0d950248bdb8_6xx0xiyk Jul 23 10:27:05 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:05 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c60207cf-8db1-44c8-9d8f-0d950248bdb8_6xx0xiyk" returned: 0 in 0.358s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c60207cf-8db1-44c8-9d8f-0d950248bdb8_6xx0xiyk {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:05 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c60207cf-8db1-44c8-9d8f-0d950248bdb8_6xx0xiyk Jul 23 10:27:05 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:06 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c60207cf-8db1-44c8-9d8f-0d950248bdb8_6xx0xiyk" returned: 1 in 0.367s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c60207cf-8db1-44c8-9d8f-0d950248bdb8_6xx0xiyk' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:27:06 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae230a0-12ed-4ae8-b9c7-809600cbe3ac]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:27:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:06 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD Jul 23 10:27:06 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:06 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD" returned: 0 in 0.514s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:06 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] c60207cf-8db1-44c8-9d8f-0d950248bdb8 was qcow2, converting to qcow2 {{(pid=88371) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 10:27:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:06 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 Jul 23 10:27:06 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:08 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039" returned: 0 in 2.133s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c60207cf-8db1-44c8-9d8f-0d950248bdb8_jv9d0mx0devstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:27:08 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Converted 112.00 MB image at 52.48 MB/s Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:08 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 1G Jul 23 10:27:08 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Flow 'volume_create_manager' (8479601d-76f1-4194-a903-c5ba5f8e4151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ab6631-638c-44f3-a058-ba02ce4cc768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ab6631-638c-44f3-a058-ba02ce4cc768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1664055456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4f7691-48b1-47f5-b656-60ac176c517b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feed3a99ac4482ac0b9559176e6518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:27:09Z,use_quota=True,user_id='25d0291f31be4db290fb7587c73cf2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874ebbe6-c282-4d7a-8efa-dbe99f5a4748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874ebbe6-c282-4d7a-8efa-dbe99f5a4748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19716baa-f6ac-48db-a5e7-4179021c763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19716baa-f6ac-48db-a5e7-4179021c763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e4f7691-48b1-47f5-b656-60ac176c517b', 'volume_name': 'volume-2e4f7691-48b1-47f5-b656-60ac176c517b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d1f6b9-6435-4953-9397-b3e813654742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d1f6b9-6435-4953-9397-b3e813654742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7354fa5f-0c79-4115-ad57-8934bd5b650b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:08 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Volume 2e4f7691-48b1-47f5-b656-60ac176c517b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e4f7691-48b1-47f5-b656-60ac176c517b', 'volume_size': 1} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1664055456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4f7691-48b1-47f5-b656-60ac176c517b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feed3a99ac4482ac0b9559176e6518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:27:09Z,use_quota=True,user_id='25d0291f31be4db290fb7587c73cf2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Creating volume 2e4f7691-48b1-47f5-b656-60ac176c517b {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:27:08 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:27:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:09 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b 1073741824 Jul 23 10:27:09 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:09 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 1G" returned: 0 in 0.551s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Downloaded image c60207cf-8db1-44c8-9d8f-0d950248bdb8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'metadata': {}}])) to volume 11282999-ef7a-4b34-be43-d211a868b039 successfully. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Temporary image c60207cf-8db1-44c8-9d8f-0d950248bdb8 for user 2d636f02e6cf45ccaa6353744769a445 is deleted. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Marking volume 11282999-ef7a-4b34-be43-d211a868b039 as bootable. {{(pid=88371) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Copying metadata from image c60207cf-8db1-44c8-9d8f-0d950248bdb8 to 11282999-ef7a-4b34-be43-d211a868b039. {{(pid=88371) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Creating volume glance metadata for volume 11282999-ef7a-4b34-be43-d211a868b039 backed by image c60207cf-8db1-44c8-9d8f-0d950248bdb8 with: {'image_id': 'c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'image_name': 'tempest-scenario-img--1576915030', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88371) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291acb7a-977f-4d6a-a2cd-8c4e6ea58323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11282999-ef7a-4b34-be43-d211a868b039', 'volume_size': 1, 'image_id': 'c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1576915030', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e96f8eaf6584a69a62d7a55cb9ad0ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c60207cf-8db1-44c8-9d8f-0d950248bdb8', 'created_at': datetime.datetime(2026, 7, 23, 8, 26, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 26, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c60207cf-8db1-44c8-9d8f-0d950248bdb8/file', 'properties': {}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d0e682-615c-43d2-a6c0-0cf8f7bba96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:09 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Volume volume-11282999-ef7a-4b34-be43-d211a868b039 (11282999-ef7a-4b34-be43-d211a868b039): created successfully Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d0e682-615c-43d2-a6c0-0cf8f7bba96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Flow 'volume_create_manager' (317cbd29-17c1-498e-b5f6-651f7cfb747a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:27:09 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1a078cfc-7325-4256-b459-7c02a370f757 tempest-TestInstancesWithCinderVolumes-1443299191 None] Created volume successfully. Jul 23 10:27:09 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b 1073741824" returned: 0 in 0.655s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:09 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b Jul 23 10:27:09 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:09 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b" returned: 0 in 0.313s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:27:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7354fa5f-0c79-4115-ad57-8934bd5b650b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e4f7691-48b1-47f5-b656-60ac176c517b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0602ce-d60d-4ee4-a17b-3d0d18a3e360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:10 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Volume volume-2e4f7691-48b1-47f5-b656-60ac176c517b (2e4f7691-48b1-47f5-b656-60ac176c517b): created successfully Jul 23 10:27:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0602ce-d60d-4ee4-a17b-3d0d18a3e360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Flow 'volume_create_manager' (8479601d-76f1-4194-a903-c5ba5f8e4151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:27:10 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-40604a5c-b764-4a52-b6e7-047553025591 tempest-AttachVolumeTestJSON-1879274770 None] Created volume successfully. Jul 23 10:27:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-3ddbb283-41c0-47e7-822e-aeb0b149a4a6 req-95f30c0f-ffa1-4853-9fc5-38e510428f35 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-3ddbb283-41c0-47e7-822e-aeb0b149a4a6 req-95f30c0f-ffa1-4853-9fc5-38e510428f35 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-3ddbb283-41c0-47e7-822e-aeb0b149a4a6 req-95f30c0f-ffa1-4853-9fc5-38e510428f35 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-3ddbb283-41c0-47e7-822e-aeb0b149a4a6 req-95f30c0f-ffa1-4853-9fc5-38e510428f35 tempest-AttachVolumeTestJSON-1879274770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-2e4f7691-48b1-47f5-b656-60ac176c517b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '066993f8-5462-49ca-b174-bb660b263cd9', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:27:12 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-3ddbb283-41c0-47e7-822e-aeb0b149a4a6 req-95f30c0f-ffa1-4853-9fc5-38e510428f35 tempest-AttachVolumeTestJSON-1879274770 None] attachment_update completed successfully. Jul 23 10:27:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-b21b150a-2e28-47be-a6ca-c1fd4e9b48e8 req-ebe9537f-9de3-4da6-8acf-2f84c5a5b5cb tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-b21b150a-2e28-47be-a6ca-c1fd4e9b48e8 req-ebe9537f-9de3-4da6-8acf-2f84c5a5b5cb tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-b21b150a-2e28-47be-a6ca-c1fd4e9b48e8 req-ebe9537f-9de3-4da6-8acf-2f84c5a5b5cb tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-b21b150a-2e28-47be-a6ca-c1fd4e9b48e8 req-ebe9537f-9de3-4da6-8acf-2f84c5a5b5cb tempest-TestInstancesWithCinderVolumes-1443299191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-11282999-ef7a-4b34-be43-d211a868b039', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '793421a9-f30d-4c7f-bca8-02b05b16d863', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:27:14 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-b21b150a-2e28-47be-a6ca-c1fd4e9b48e8 req-ebe9537f-9de3-4da6-8acf-2f84c5a5b5cb tempest-TestInstancesWithCinderVolumes-1443299191 None] attachment_update completed successfully. Jul 23 10:27:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-9ee364ea-b420-4c38-852d-798c5a17066e req-df3e9ca9-dbe6-46a3-8b8a-57eaf56b836a tempest-AttachVolumeTestJSON-1879274770 None] Terminate volume connection completed successfully. Jul 23 10:27:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9ee364ea-b420-4c38-852d-798c5a17066e req-df3e9ca9-dbe6-46a3-8b8a-57eaf56b836a tempest-AttachVolumeTestJSON-1879274770 None] Deleting attachment 3d861568-bf7c-43df-a985-c0f78fef7e6e. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:27:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-9f79d308-680c-48a2-b460-eafc537fab58 req-e1b80602-d254-44bd-807d-5a4b3145b45d tempest-AttachVolumeTestJSON-1879274770 None] Terminate volume connection completed successfully. Jul 23 10:27:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-9f79d308-680c-48a2-b460-eafc537fab58 req-e1b80602-d254-44bd-807d-5a4b3145b45d tempest-AttachVolumeTestJSON-1879274770 None] Deleting attachment 066993f8-5462-49ca-b174-bb660b263cd9. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:27:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-1a01c1a1-dd89-4425-a1f8-cc6cdd650975 req-533711b1-6a40-4746-b921-a3b5eedff1e2 tempest-AttachVolumeNegativeTest-1247823510 None] Terminate volume connection completed successfully. Jul 23 10:27:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-1a01c1a1-dd89-4425-a1f8-cc6cdd650975 req-533711b1-6a40-4746-b921-a3b5eedff1e2 tempest-AttachVolumeNegativeTest-1247823510 None] Deleting attachment 13da6f76-6e3a-4ba6-89d8-a7d88455412a. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:27:26 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "cinder-2e4f7691-48b1-47f5-b656-60ac176c517b-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:26 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-2e4f7691-48b1-47f5-b656-60ac176c517b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:26 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=52,cinder:UPDATE=34,cinder:INSERT=9,cinder:DELETE=4 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:27:26 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=70,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=7 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:27:26 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "cinder-quobyte-2e4f7691-48b1-47f5-b656-60ac176c517b" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:26 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-quobyte-2e4f7691-48b1-47f5-b656-60ac176c517b" acquired by "delete_volume" :: waited 0.037s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:26 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e43a837-c9f1-4f0a-a798-cccdbb51c101]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:27:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:27 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b Jul 23 10:27:27 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:27 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b" returned: 0 in 0.741s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:27 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b Jul 23 10:27:27 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:28 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e4f7691-48b1-47f5-b656-60ac176c517b" returned: 0 in 0.495s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-quobyte-2e4f7691-48b1-47f5-b656-60ac176c517b" released by "delete_volume" :: held 1.332s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:28 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Created reservations ['1a504d19-4447-4c11-97ea-905fde1e2ffa', '1310f7e9-b52f-4d8c-8890-fda94ed2e4f0', '41c02571-c8c5-46ab-ac5f-9d7250355beb', 'f1afb57a-efff-49bf-9ebf-382d75a351a0'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:27:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:28 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:27:28 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:29 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.642s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:29 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:27:29 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Deleted volume successfully. Jul 23 10:27:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d53d8a94-7f0c-412e-8a30-4189837f7681 tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-2e4f7691-48b1-47f5-b656-60ac176c517b-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "cinder-0d6df2e3-b590-45dd-9360-13732f2257f0-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-0d6df2e3-b590-45dd-9360-13732f2257f0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "cinder-quobyte-0d6df2e3-b590-45dd-9360-13732f2257f0" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-quobyte-0d6df2e3-b590-45dd-9360-13732f2257f0" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:29 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e48690-99f9-47bc-8a74-619a91426898]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:27:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:29 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0 Jul 23 10:27:29 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:30 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0" returned: 0 in 0.759s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:30 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0 Jul 23 10:27:30 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:30 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d6df2e3-b590-45dd-9360-13732f2257f0" returned: 0 in 0.344s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-quobyte-0d6df2e3-b590-45dd-9360-13732f2257f0" released by "delete_volume" :: held 1.175s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:30 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Created reservations ['c6a7efb3-6b1f-4f0e-a377-67e2cf242944', '78781a7a-4765-46ab-96d2-1df2d764da45', '8274154a-0a6f-4825-bffb-524c8a5607a3', '3eac68d4-4a01-4515-9c0f-7d7d84e0ae92'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:27:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:30 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:27:30 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:31 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.372s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:31 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:27:31 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Deleted volume successfully. Jul 23 10:27:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49e34590-b79b-4e23-9038-5190638471a1 tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-0d6df2e3-b590-45dd-9360-13732f2257f0-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "cinder-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "cinder-quobyte-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-quobyte-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592" acquired by "delete_volume" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:31 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e6e69-47ed-4778-ab85-7a09b6420610]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:27:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:32 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592 Jul 23 10:27:32 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:32 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592" returned: 0 in 0.869s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:32 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592 Jul 23 10:27:32 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:33 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592" returned: 0 in 0.647s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:33 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-quobyte-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592" released by "delete_volume" :: held 1.586s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:33 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Created reservations ['a2282f33-c682-4b4a-a0bb-855fa03a643a', 'b0850065-024b-472a-abea-d3c287671d82', '0e291174-ab90-4695-b73e-ff0b840e68e8', '46572506-1805-45e8-8b11-a1645e275e28'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:27:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:33 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:27:33 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:34 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.602s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:34 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:27:34 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Deleted volume successfully. Jul 23 10:27:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9075bd03-cc48-4023-830c-e444e73b19cf tempest-AttachVolumeTestJSON-1879274770 None] Lock "cinder-c1c51fa9-3dc9-4144-8a56-d3e44e7d9592-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:43 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=18 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Flow 'volume_create_manager' (531aaa87-d9ee-47ae-8b97-62cad8dd5f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d0f5f1-52da-4c8e-92e6-433081d5d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d0f5f1-52da-4c8e-92e6-433081d5d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1383088566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1835a37c-7d64-4c84-a8e0-0cffb1fd959e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='266366b37b414348b204e76546d8322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:27:44Z,use_quota=True,user_id='5cd53e3b729047aba2f3f4ce37d61a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ab7aa5-2ffd-426a-bb13-37307470e150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ab7aa5-2ffd-426a-bb13-37307470e150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fcadb6-5f57-4464-8987-cb44414da660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fcadb6-5f57-4464-8987-cb44414da660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1835a37c-7d64-4c84-a8e0-0cffb1fd959e', 'volume_name': 'volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1baccf58-2be1-4ba2-987c-7bdbbe575c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1baccf58-2be1-4ba2-987c-7bdbbe575c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38144ce4-d1d1-4144-ba06-3710c5b0a65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:44 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Volume 1835a37c-7d64-4c84-a8e0-0cffb1fd959e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e', 'volume_size': 1} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1383088566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1835a37c-7d64-4c84-a8e0-0cffb1fd959e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='266366b37b414348b204e76546d8322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:27:44Z,use_quota=True,user_id='5cd53e3b729047aba2f3f4ce37d61a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Creating volume 1835a37c-7d64-4c84-a8e0-0cffb1fd959e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:27:44 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:44 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e 1073741824 Jul 23 10:27:44 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:44 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e 1073741824" returned: 0 in 0.476s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:44 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e Jul 23 10:27:44 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:44 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e" returned: 0 in 0.283s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38144ce4-d1d1-4144-ba06-3710c5b0a65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f652c209-98db-447c-ab44-39c1a2c53208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:44 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Volume volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e (1835a37c-7d64-4c84-a8e0-0cffb1fd959e): created successfully Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f652c209-98db-447c-ab44-39c1a2c53208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Flow 'volume_create_manager' (531aaa87-d9ee-47ae-8b97-62cad8dd5f59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:27:44 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8e35ec45-56be-488c-9a31-cda668bf60f2 tempest-VolumesTestJSON-286562400 None] Created volume successfully. Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:46 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:27:46 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:46 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.296s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Flow 'volume_create_manager' (7c2af3c2-41e5-4ddb-9655-6e1acf3f25aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ce69e5-4bf7-40a9-b9b9-565552fe8cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ce69e5-4bf7-40a9-b9b9-565552fe8cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1216887240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0903ea-0b96-45fd-9ced-69ecba72f437,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='266366b37b414348b204e76546d8322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:27:47Z,use_quota=True,user_id='5cd53e3b729047aba2f3f4ce37d61a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9bf0b7-3f34-49c0-ac5a-d809040cdf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9bf0b7-3f34-49c0-ac5a-d809040cdf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2e3d03-69fd-4b9c-8875-1d55e4e802c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2e3d03-69fd-4b9c-8875-1d55e4e802c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0903ea-0b96-45fd-9ced-69ecba72f437', 'volume_name': 'volume-3c0903ea-0b96-45fd-9ced-69ecba72f437', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884ecf12-c954-4ad0-b4d8-570f87318cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884ecf12-c954-4ad0-b4d8-570f87318cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34629902-2ba1-403f-806e-f3ef1463f6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:46 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Volume 3c0903ea-0b96-45fd-9ced-69ecba72f437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0903ea-0b96-45fd-9ced-69ecba72f437', 'volume_size': 1} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1216887240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0903ea-0b96-45fd-9ced-69ecba72f437,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='266366b37b414348b204e76546d8322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:27:47Z,use_quota=True,user_id='5cd53e3b729047aba2f3f4ce37d61a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Creating volume 3c0903ea-0b96-45fd-9ced-69ecba72f437 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:27:46 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:27:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:46 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437 1073741824 Jul 23 10:27:46 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:47 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437 1073741824" returned: 0 in 0.405s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:47 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437 Jul 23 10:27:47 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:47 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437" returned: 0 in 0.238s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:27:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34629902-2ba1-403f-806e-f3ef1463f6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0903ea-0b96-45fd-9ced-69ecba72f437', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a465a0dc-64e6-42be-a54d-edd11936373a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:47 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Volume volume-3c0903ea-0b96-45fd-9ced-69ecba72f437 (3c0903ea-0b96-45fd-9ced-69ecba72f437): created successfully Jul 23 10:27:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a465a0dc-64e6-42be-a54d-edd11936373a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Flow 'volume_create_manager' (7c2af3c2-41e5-4ddb-9655-6e1acf3f25aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:27:47 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fdac9589-f2e2-4759-8ee2-77f1f39a9c92 tempest-VolumesTestJSON-286562400 None] Created volume successfully. Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Flow 'volume_create_manager' (b6316f4c-58e2-45d2-ba4c-86c51dfa16f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ae2477-4ba3-41cb-ba22-8bdb53808cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ae2477-4ba3-41cb-ba22-8bdb53808cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-310915238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c415fab-79d0-46db-935e-f8ddfd84bb82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='266366b37b414348b204e76546d8322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:27:48Z,use_quota=True,user_id='5cd53e3b729047aba2f3f4ce37d61a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aef6e44-7ea1-4016-b297-a5fb4420bdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aef6e44-7ea1-4016-b297-a5fb4420bdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1c5e7f-700d-4730-8222-3cc7599db1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1c5e7f-700d-4730-8222-3cc7599db1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c415fab-79d0-46db-935e-f8ddfd84bb82', 'volume_name': 'volume-5c415fab-79d0-46db-935e-f8ddfd84bb82', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5633f005-6819-4c07-9109-50d1d57098d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5633f005-6819-4c07-9109-50d1d57098d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ddc665-e6bb-4062-9dcb-a9b0308ed6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:48 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Volume 5c415fab-79d0-46db-935e-f8ddfd84bb82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c415fab-79d0-46db-935e-f8ddfd84bb82', 'volume_size': 1} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-310915238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c415fab-79d0-46db-935e-f8ddfd84bb82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='266366b37b414348b204e76546d8322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:27:48Z,use_quota=True,user_id='5cd53e3b729047aba2f3f4ce37d61a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Creating volume 5c415fab-79d0-46db-935e-f8ddfd84bb82 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:27:48 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:27:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:48 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82 1073741824 Jul 23 10:27:48 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-20080132-ec76-4732-990e-aca2f8ff3da9 req-fe52775e-d928-4ff7-899a-27568b22dadf tempest-TestStampPattern-342022455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:49 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82 1073741824" returned: 0 in 0.649s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:49 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82 Jul 23 10:27:49 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:49 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82" returned: 0 in 0.265s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-20080132-ec76-4732-990e-aca2f8ff3da9 req-fe52775e-d928-4ff7-899a-27568b22dadf tempest-TestStampPattern-342022455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.384s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ddc665-e6bb-4062-9dcb-a9b0308ed6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c415fab-79d0-46db-935e-f8ddfd84bb82', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6000e0a-3fd7-4ae9-ab29-08f164702d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:27:49 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Volume volume-5c415fab-79d0-46db-935e-f8ddfd84bb82 (5c415fab-79d0-46db-935e-f8ddfd84bb82): created successfully Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6000e0a-3fd7-4ae9-ab29-08f164702d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Flow 'volume_create_manager' (b6316f4c-58e2-45d2-ba4c-86c51dfa16f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[48725413-36f9-41e7-85d3-52fd36ea3eb7]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-20080132-ec76-4732-990e-aca2f8ff3da9 req-fe52775e-d928-4ff7-899a-27568b22dadf tempest-TestStampPattern-342022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:49 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6b73bcdc-6818-4ec5-a92f-cd43887a7a00 tempest-VolumesTestJSON-286562400 None] Created volume successfully. Jul 23 10:27:49 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 Jul 23 10:27:49 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:49 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-20080132-ec76-4732-990e-aca2f8ff3da9 req-fe52775e-d928-4ff7-899a-27568b22dadf tempest-TestStampPattern-342022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721" returned: 0 in 0.406s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-20080132-ec76-4732-990e-aca2f8ff3da9 req-fe52775e-d928-4ff7-899a-27568b22dadf tempest-TestStampPattern-342022455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.469s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-20080132-ec76-4732-990e-aca2f8ff3da9 req-fe52775e-d928-4ff7-899a-27568b22dadf tempest-TestStampPattern-342022455 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-51291fd8-ecc4-4c28-8d60-f7d02e132721', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52293903-7315-4d56-bfaa-12eb4ee307d6', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:27:49 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-20080132-ec76-4732-990e-aca2f8ff3da9 req-fe52775e-d928-4ff7-899a-27568b22dadf tempest-TestStampPattern-342022455 None] attachment_update completed successfully. Jul 23 10:27:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Acquiring lock "cinder-5c415fab-79d0-46db-935e-f8ddfd84bb82-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Lock "cinder-5c415fab-79d0-46db-935e-f8ddfd84bb82-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Acquiring lock "cinder-quobyte-5c415fab-79d0-46db-935e-f8ddfd84bb82" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Lock "cinder-quobyte-5c415fab-79d0-46db-935e-f8ddfd84bb82" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:51 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdde1a4-586d-4bb5-a2b7-d411d3e03249]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:27:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:51 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82 Jul 23 10:27:51 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:51 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82" returned: 0 in 0.368s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:51 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82 Jul 23 10:27:51 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:52 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c415fab-79d0-46db-935e-f8ddfd84bb82" returned: 0 in 0.271s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Lock "cinder-quobyte-5c415fab-79d0-46db-935e-f8ddfd84bb82" released by "delete_volume" :: held 0.676s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Created reservations ['7c1877b7-ce4e-4887-97cc-99656a2cf41c', '54930b8a-21f8-4612-a4d6-86ac05fa6c2f', 'a33e9268-90c0-44e9-8001-01e5f34ea1e5', '1fb96462-7b3a-4431-9d9c-228888b2a0cb'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:52 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:27:52 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:52 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.272s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:27:52 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Deleted volume successfully. Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca5fbd2a-69af-4815-a74f-f2eae9e0d03d tempest-VolumesTestJSON-286562400 None] Lock "cinder-5c415fab-79d0-46db-935e-f8ddfd84bb82-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Acquiring lock "cinder-3c0903ea-0b96-45fd-9ced-69ecba72f437-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Lock "cinder-3c0903ea-0b96-45fd-9ced-69ecba72f437-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Acquiring lock "cinder-quobyte-3c0903ea-0b96-45fd-9ced-69ecba72f437" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Lock "cinder-quobyte-3c0903ea-0b96-45fd-9ced-69ecba72f437" acquired by "delete_volume" :: waited 0.030s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4967114c-6f75-4107-8dbd-78bfee67e87a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:27:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:52 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437 Jul 23 10:27:52 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:53 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437" returned: 0 in 0.444s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:53 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437 Jul 23 10:27:53 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:53 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3c0903ea-0b96-45fd-9ced-69ecba72f437" returned: 0 in 0.288s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Lock "cinder-quobyte-3c0903ea-0b96-45fd-9ced-69ecba72f437" released by "delete_volume" :: held 0.783s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Created reservations ['ee43e5bf-c9cd-415a-8350-8947dd200550', '5064a260-f51c-457b-a1c4-ff7915678e4b', '3bb12fef-b2c0-435a-a52b-c31b2eb349c0', 'ebb39c8c-7ded-44de-86e0-41681152f104'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:53 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:27:53 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-f1fdcfaf-7ab0-4019-897a-2e5811cc1985 req-7e25f8d7-57db-42a4-9fe0-984893f1f38f tempest-TestStampPattern-342022455 None] Terminate volume connection completed successfully. Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-f1fdcfaf-7ab0-4019-897a-2e5811cc1985 req-7e25f8d7-57db-42a4-9fe0-984893f1f38f tempest-TestStampPattern-342022455 None] Deleting attachment 52293903-7315-4d56-bfaa-12eb4ee307d6. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Acquiring lock "cinder-1835a37c-7d64-4c84-a8e0-0cffb1fd959e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Lock "cinder-1835a37c-7d64-4c84-a8e0-0cffb1fd959e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Acquiring lock "cinder-quobyte-1835a37c-7d64-4c84-a8e0-0cffb1fd959e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:54 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.356s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:27:54 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Deleted volume successfully. Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Lock "cinder-quobyte-1835a37c-7d64-4c84-a8e0-0cffb1fd959e" acquired by "delete_volume" :: waited 0.035s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e0f5c269-bee8-4f1a-adb9-f3d1b60d7985 tempest-VolumesTestJSON-286562400 None] Lock "cinder-3c0903ea-0b96-45fd-9ced-69ecba72f437-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8319b4-2d2e-45a5-925f-79b8a8c11a00]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:54 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e Jul 23 10:27:54 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:54 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e" returned: 0 in 0.385s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:54 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e Jul 23 10:27:54 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:54 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-1835a37c-7d64-4c84-a8e0-0cffb1fd959e" returned: 0 in 0.256s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Lock "cinder-quobyte-1835a37c-7d64-4c84-a8e0-0cffb1fd959e" released by "delete_volume" :: held 0.692s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Created reservations ['776308c8-dc32-479e-8654-cc43802b1ca4', 'a28eef79-d6fc-42e6-904d-c58df90577d7', '1ebfa8c9-e21b-435e-9c58-7a90963f7232', '00e09206-8278-451d-9b3c-6deddc6c3527'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:54 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:27:54 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:55 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.357s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:55 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:27:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Deleted volume successfully. Jul 23 10:27:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf44d37d-682b-469f-b7dd-0f8fe9705552 tempest-VolumesTestJSON-286562400 None] Lock "cinder-1835a37c-7d64-4c84-a8e0-0cffb1fd959e-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-3ff72267-829b-413b-a8f7-226167890322 req-b9ded0af-a0d4-478c-82d0-27055cada6d2 tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-3ff72267-829b-413b-a8f7-226167890322 req-b9ded0af-a0d4-478c-82d0-27055cada6d2 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-3ff72267-829b-413b-a8f7-226167890322 req-b9ded0af-a0d4-478c-82d0-27055cada6d2 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-3ff72267-829b-413b-a8f7-226167890322 req-b9ded0af-a0d4-478c-82d0-27055cada6d2 tempest-TestInstancesWithCinderVolumes-1443299191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-0ec60abe-598c-441b-b34e-9065b56d6b49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75966df2-af16-4d6c-90f7-17465255e928', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:27:56 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-3ff72267-829b-413b-a8f7-226167890322 req-b9ded0af-a0d4-478c-82d0-27055cada6d2 tempest-TestInstancesWithCinderVolumes-1443299191 None] attachment_update completed successfully. Jul 23 10:27:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Acquiring lock "cinder-51291fd8-ecc4-4c28-8d60-f7d02e132721-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Lock "cinder-51291fd8-ecc4-4c28-8d60-f7d02e132721-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Acquiring lock "cinder-quobyte-51291fd8-ecc4-4c28-8d60-f7d02e132721" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:27:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-51291fd8-ecc4-4c28-8d60-f7d02e132721" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:27:58 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[950267ec-3254-4bf6-bcb5-dbd50e9ed468]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:27:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:58 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 Jul 23 10:27:58 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:59 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721" returned: 0 in 0.424s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:59 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721 Jul 23 10:27:59 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:27:59 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-51291fd8-ecc4-4c28-8d60-f7d02e132721" returned: 0 in 0.279s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-51291fd8-ecc4-4c28-8d60-f7d02e132721" released by "delete_volume" :: held 0.758s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-7c88d7ef-d419-45e1-8480-f4865afbd20a req-bba17859-88da-482c-bcc9-fc59dea82ddf tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-7c88d7ef-d419-45e1-8480-f4865afbd20a req-bba17859-88da-482c-bcc9-fc59dea82ddf tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-7c88d7ef-d419-45e1-8480-f4865afbd20a req-bba17859-88da-482c-bcc9-fc59dea82ddf tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Created reservations ['02ed6576-76ca-47e8-88d4-02fdeb7c7248', 'ef493d36-8fb9-4439-9e45-ffae28b05692', '12eb74e2-cf18-4eff-b5ed-47891214df26', '0a5abfeb-9fbb-4f14-818d-fcae48e4c2a0'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-7c88d7ef-d419-45e1-8480-f4865afbd20a req-bba17859-88da-482c-bcc9-fc59dea82ddf tempest-TestInstancesWithCinderVolumes-1443299191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-ebcc96c3-c913-4338-8721-ac49d4ec6245', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfaf1984-2a23-42e2-8a63-ad7bd929f62e', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:27:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:27:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-7c88d7ef-d419-45e1-8480-f4865afbd20a req-bba17859-88da-482c-bcc9-fc59dea82ddf tempest-TestInstancesWithCinderVolumes-1443299191 None] attachment_update completed successfully. Jul 23 10:27:59 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:27:59 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:00 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.325s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:28:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Deleted volume successfully. Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bac8b38f-7534-4ed4-aa0b-8fc958d1ae58 tempest-BackendsCapabilitiesAdminTestsJSON-363573077 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88371) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3533f3aa-fd49-40eb-bedf-e1b5a12fcb03 tempest-TestStampPattern-342022455 None] Lock "cinder-51291fd8-ecc4-4c28-8d60-f7d02e132721-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-530597a8-38f3-42ef-8ef2-0a60ed1d0025 tempest-BackendsCapabilitiesAdminTestsJSON-363573077 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88371) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Acquiring lock "cinder-bf42c26b-8b72-4cd8-8973-bd1db158cbd4-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Lock "cinder-bf42c26b-8b72-4cd8-8973-bd1db158cbd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Acquiring lock "cinder-quobyte-39187049-8f93-42e7-875b-2b150dd3daca" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-39187049-8f93-42e7-875b-2b150dd3daca" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Acquiring lock "cinder-quobyte-bf42c26b-8b72-4cd8-8973-bd1db158cbd4" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-bf42c26b-8b72-4cd8-8973-bd1db158cbd4" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Deleting offline snapshot bf42c26b-8b72-4cd8-8973-bd1db158cbd4 of volume 39187049-8f93-42e7-875b-2b150dd3daca {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] snapshot_file for this snap is: volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9038df82-2661-4027-8b84-b6d69b284afb]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:00 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 Jul 23 10:28:00 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:01 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4" returned: 0 in 0.537s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39187049-8f93-42e7-875b-2b150dd3daca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:28:01 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c90ebc3-ce72-44ef-9aef-47ad28bee068]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:01 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca Jul 23 10:28:01 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:01 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca" returned: 0 in 0.469s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:01 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 Jul 23 10:28:01 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:02 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4" returned: 0 in 0.458s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:02 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4 Jul 23 10:28:02 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:02 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca.bf42c26b-8b72-4cd8-8973-bd1db158cbd4" returned: 0 in 0.337s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-bf42c26b-8b72-4cd8-8973-bd1db158cbd4" released by "_delete_snapshot" :: held 1.954s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-39187049-8f93-42e7-875b-2b150dd3daca" released by "delete_snapshot" :: held 2.003s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:02 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Created reservations ['00a49865-767b-470e-a585-3433aa3dbcc5', '4f7c3c43-9eb5-4301-8955-a091c596d844', '27ca331c-d929-4576-b6e5-e0053efed6ef', '7dbb3ce8-91de-4b2a-adb0-63b57beaf1bd'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:28:02 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Delete snapshot completed successfully. Jul 23 10:28:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49ccafb5-496e-424d-8547-7dedc12c5a80 tempest-TestStampPattern-342022455 None] Lock "cinder-bf42c26b-8b72-4cd8-8973-bd1db158cbd4-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:04 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Flow 'volume_create_manager' (425a21a1-5935-47be-8d6c-d04ff3dca286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3775316f-952c-412f-a9f7-2f3aad75a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3775316f-952c-412f-a9f7-2f3aad75a51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1998063674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbf5289-28ba-43a9-bc84-a651c8f2631e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2758e78e00c943daba79fdfababca49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:05Z,use_quota=True,user_id='85ebb403d3234076aa99e0155c2b0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee24dac-bea5-4e5c-b1e2-8935749aa24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee24dac-bea5-4e5c-b1e2-8935749aa24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f49b29-018c-47d9-8fbe-d2fadbdf7eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f49b29-018c-47d9-8fbe-d2fadbdf7eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdbf5289-28ba-43a9-bc84-a651c8f2631e', 'volume_name': 'volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe64bcba-c125-47fc-9876-1ccc6fc3b63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe64bcba-c125-47fc-9876-1ccc6fc3b63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693ab686-d526-49dc-8c7f-ef4ceb44e181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:05 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Volume bdbf5289-28ba-43a9-bc84-a651c8f2631e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e', 'volume_size': 1} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1998063674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbf5289-28ba-43a9-bc84-a651c8f2631e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2758e78e00c943daba79fdfababca49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:05Z,use_quota=True,user_id='85ebb403d3234076aa99e0155c2b0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Creating volume bdbf5289-28ba-43a9-bc84-a651c8f2631e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:28:05 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:05 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e 1073741824 Jul 23 10:28:05 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:05 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e 1073741824" returned: 0 in 0.768s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:05 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e Jul 23 10:28:05 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:06 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e" returned: 0 in 0.305s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:28:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693ab686-d526-49dc-8c7f-ef4ceb44e181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca880f29-e969-412b-b4ad-f170f377a434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:06 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Volume volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e (bdbf5289-28ba-43a9-bc84-a651c8f2631e): created successfully Jul 23 10:28:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca880f29-e969-412b-b4ad-f170f377a434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Flow 'volume_create_manager' (425a21a1-5935-47be-8d6c-d04ff3dca286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:06 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-17bf8a38-0c76-4dac-9b73-859888bd27cc tempest-AttachVolumeNegativeTest-1247823510 None] Created volume successfully. Jul 23 10:28:06 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-e892763f-1a5a-4903-9d0e-1a804fb64386 req-476323dd-bc0c-40b8-a5af-439b0d1908a6 tempest-TestInstancesWithCinderVolumes-1443299191 None] Terminate volume connection completed successfully. Jul 23 10:28:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-e892763f-1a5a-4903-9d0e-1a804fb64386 req-476323dd-bc0c-40b8-a5af-439b0d1908a6 tempest-TestInstancesWithCinderVolumes-1443299191 None] Deleting attachment 75966df2-af16-4d6c-90f7-17465255e928. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:28:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Acquiring lock "cinder-39187049-8f93-42e7-875b-2b150dd3daca-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Lock "cinder-39187049-8f93-42e7-875b-2b150dd3daca-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Acquiring lock "cinder-quobyte-39187049-8f93-42e7-875b-2b150dd3daca" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-39187049-8f93-42e7-875b-2b150dd3daca" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc89f948-1fe0-4816-bb54-b7df922d1118]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:07 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca Jul 23 10:28:07 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "cinder-0ec60abe-598c-441b-b34e-9065b56d6b49-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-0ec60abe-598c-441b-b34e-9065b56d6b49-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:07 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "cinder-quobyte-0ec60abe-598c-441b-b34e-9065b56d6b49" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca" returned: 0 in 0.518s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:07 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca Jul 23 10:28:07 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-quobyte-0ec60abe-598c-441b-b34e-9065b56d6b49" acquired by "delete_volume" :: waited 0.059s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd5179-6fba-4138-9d06-1da9435b9ec2]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:07 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49 Jul 23 10:28:07 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:07 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-39187049-8f93-42e7-875b-2b150dd3daca" returned: 0 in 0.368s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Lock "cinder-quobyte-39187049-8f93-42e7-875b-2b150dd3daca" released by "delete_volume" :: held 0.978s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-40194163-ea8e-4932-9ebd-967609448a22 req-fdd506e2-62bf-44cf-97a8-5d7f40749f9f tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-40194163-ea8e-4932-9ebd-967609448a22 req-fdd506e2-62bf-44cf-97a8-5d7f40749f9f tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Created reservations ['749b4e1f-b2d5-4d51-b1ab-15310b61801d', '3f3ee22a-b138-4bc9-8400-065aa1742376', 'a1e35d2c-a2f9-451d-8f25-f611b1096b8e', '683bb50e-5dff-4da3-9107-287f94221c1d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-40194163-ea8e-4932-9ebd-967609448a22 req-fdd506e2-62bf-44cf-97a8-5d7f40749f9f tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:08 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49" returned: 0 in 0.465s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-40194163-ea8e-4932-9ebd-967609448a22 req-fdd506e2-62bf-44cf-97a8-5d7f40749f9f tempest-AttachVolumeNegativeTest-1247823510 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cd80e5f-6edc-4212-b6c2-293bbaafa1c6', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:28:08 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49 Jul 23 10:28:08 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:08 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:28:08 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:08 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-40194163-ea8e-4932-9ebd-967609448a22 req-fdd506e2-62bf-44cf-97a8-5d7f40749f9f tempest-AttachVolumeNegativeTest-1247823510 None] attachment_update completed successfully. Jul 23 10:28:08 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ec60abe-598c-441b-b34e-9065b56d6b49" returned: 0 in 0.368s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-quobyte-0ec60abe-598c-441b-b34e-9065b56d6b49" released by "delete_volume" :: held 0.915s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:08 devstack cinder-volume[88371]: WARNING cinder.quota [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-53958435-199743691 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-53958435-199743691, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:28:08 devstack cinder-volume[88371]: WARNING cinder.quota [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-53958435-199743691 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-53958435-199743691, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Created reservations ['67858b0b-48e0-484e-905b-94427efad7df', 'fea21fdf-78be-4e9f-bd59-433700ae2ca2', '6f9d10c1-eb15-422a-b448-085769feb328', 'd32c9129-8cfc-4f1c-a949-886e53f4fe82'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:28:08 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.382s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:28:08 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Deleted volume successfully. Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-93d52d39-5f36-42c9-ba48-f062a1e6085e tempest-TestStampPattern-342022455 None] Lock "cinder-39187049-8f93-42e7-875b-2b150dd3daca-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:08 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:28:08 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:09 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.324s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:09 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:28:09 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Deleted volume successfully. Jul 23 10:28:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4b99f91b-d24a-4c0f-ab5a-b6d1df734a78 tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-0ec60abe-598c-441b-b34e-9065b56d6b49-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:11 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-6364de21-1fb2-460f-a485-422dc4e563f8 req-d512dfc5-f8ea-49cc-9888-30b633551d60 tempest-AttachVolumeNegativeTest-1247823510 None] Terminate volume connection completed successfully. Jul 23 10:28:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-6364de21-1fb2-460f-a485-422dc4e563f8 req-d512dfc5-f8ea-49cc-9888-30b633551d60 tempest-AttachVolumeNegativeTest-1247823510 None] Deleting attachment 8cd80e5f-6edc-4212-b6c2-293bbaafa1c6. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:28:12 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-2dc36d74-3209-49b0-8f8e-464a8af75ec7 req-ba686f05-6f18-4815-b574-6a8660a85e91 tempest-TestInstancesWithCinderVolumes-1443299191 None] Terminate volume connection completed successfully. Jul 23 10:28:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-2dc36d74-3209-49b0-8f8e-464a8af75ec7 req-ba686f05-6f18-4815-b574-6a8660a85e91 tempest-TestInstancesWithCinderVolumes-1443299191 None] Deleting attachment dfaf1984-2a23-42e2-8a63-ad7bd929f62e. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:28:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "cinder-ebcc96c3-c913-4338-8721-ac49d4ec6245-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-ebcc96c3-c913-4338-8721-ac49d4ec6245-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "cinder-quobyte-ebcc96c3-c913-4338-8721-ac49d4ec6245" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-quobyte-ebcc96c3-c913-4338-8721-ac49d4ec6245" acquired by "delete_volume" :: waited 0.040s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:13 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3acf4f2-50ee-4aff-a508-a12ce4d7191a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:13 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245 Jul 23 10:28:13 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:13 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245" returned: 0 in 0.451s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:13 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245 Jul 23 10:28:13 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:13 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ebcc96c3-c913-4338-8721-ac49d4ec6245" returned: 0 in 0.322s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-quobyte-ebcc96c3-c913-4338-8721-ac49d4ec6245" released by "delete_volume" :: held 0.845s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:13 devstack cinder-volume[88371]: WARNING cinder.quota [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1797011101-947364070 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1797011101-947364070, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:28:13 devstack cinder-volume[88371]: WARNING cinder.quota [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1797011101-947364070 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1797011101-947364070, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:28:13 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Created reservations ['32d2bafd-22d6-4178-ad10-e454e71542c2', 'e8b37048-d709-493a-8bea-1a846da86158', '1d58bab7-d1ea-459f-b114-a3bf6689a2f2', '3209e145-2c08-4a69-ab94-5c85677334bf'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:28:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:14 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:28:14 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:14 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.362s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:14 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:28:14 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Deleted volume successfully. Jul 23 10:28:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4aee9394-1386-431d-b7c2-9481fa8dff1d tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-ebcc96c3-c913-4338-8721-ac49d4ec6245-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8bfc68fc-984e-490f-93d9-1a77e6789598 tempest-GroupsV320Test-752121915 None] Group tempest-GroupsV320Test-Group-1801541774: creating Jul 23 10:28:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8bfc68fc-984e-490f-93d9-1a77e6789598 tempest-GroupsV320Test-752121915 None] Group tempest-GroupsV320Test-Group-1801541774: created successfully Jul 23 10:28:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8bfc68fc-984e-490f-93d9-1a77e6789598 tempest-GroupsV320Test-752121915 None] Create group completed successfully. Jul 23 10:28:16 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-372b193d-034e-4362-b057-e6d9f9348099 tempest-GroupsV320Test-752121915 None] Created reservations ['159d0cc8-c76f-47b5-a862-cf51befcda28'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:28:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-372b193d-034e-4362-b057-e6d9f9348099 tempest-GroupsV320Test-752121915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-372b193d-034e-4362-b057-e6d9f9348099 tempest-GroupsV320Test-752121915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-372b193d-034e-4362-b057-e6d9f9348099 tempest-GroupsV320Test-752121915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-372b193d-034e-4362-b057-e6d9f9348099 tempest-GroupsV320Test-752121915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-372b193d-034e-4362-b057-e6d9f9348099 tempest-GroupsV320Test-752121915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-372b193d-034e-4362-b057-e6d9f9348099 tempest-GroupsV320Test-752121915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:16 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:28:16 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:17 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-372b193d-034e-4362-b057-e6d9f9348099 tempest-GroupsV320Test-752121915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.361s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:17 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-372b193d-034e-4362-b057-e6d9f9348099 tempest-GroupsV320Test-752121915 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:28:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-372b193d-034e-4362-b057-e6d9f9348099 tempest-GroupsV320Test-752121915 None] Delete group completed successfully. Jul 23 10:28:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-b4cfabce-f7d5-48d5-8a72-665e21ec38d7 req-1e61dbbe-6f65-46ec-999d-3c9fe6ed23c9 tempest-TestInstancesWithCinderVolumes-1443299191 None] Terminate volume connection completed successfully. Jul 23 10:28:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-b4cfabce-f7d5-48d5-8a72-665e21ec38d7 req-1e61dbbe-6f65-46ec-999d-3c9fe6ed23c9 tempest-TestInstancesWithCinderVolumes-1443299191 None] Deleting attachment 793421a9-f30d-4c7f-bca8-02b05b16d863. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:28:21 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "cinder-11282999-ef7a-4b34-be43-d211a868b039-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:21 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-11282999-ef7a-4b34-be43-d211a868b039-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:21 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "cinder-quobyte-11282999-ef7a-4b34-be43-d211a868b039" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:21 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-quobyte-11282999-ef7a-4b34-be43-d211a868b039" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:21 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2a1b9f-735a-45b5-911a-ea3a2ba45ae2]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:21 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 Jul 23 10:28:21 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:21 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039" returned: 0 in 0.468s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:21 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039 Jul 23 10:28:21 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:22 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-11282999-ef7a-4b34-be43-d211a868b039" returned: 0 in 0.394s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-quobyte-11282999-ef7a-4b34-be43-d211a868b039" released by "delete_volume" :: held 0.920s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:22 devstack cinder-volume[88371]: WARNING cinder.quota [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-747908917-1804634899 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-747908917-1804634899, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:28:22 devstack cinder-volume[88371]: WARNING cinder.quota [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-747908917-1804634899 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-747908917-1804634899, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Created reservations ['b7053881-aec9-40e3-9ff1-2efe781f769b', '66c7057f-8a19-4d93-9bc4-d81305360078', '4c9ca1a6-6507-4825-aa81-a19853f054a0', 'cdb38293-11ed-469d-b827-56184857d3bd'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:22 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:28:22 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:22 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.342s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:28:22 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Deleted volume successfully. Jul 23 10:28:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-549162b6-c29b-4db8-9e8e-5694361747db tempest-TestInstancesWithCinderVolumes-1443299191 None] Lock "cinder-11282999-ef7a-4b34-be43-d211a868b039-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:30 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=108,cinder:INSERT=25,cinder:UPDATE=111,cinder:DELETE=10 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:28:30 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:28:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Flow 'volume_create_manager' (615dd588-83f2-45b3-a9ac-b7e388070810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c06d742-2b05-4cf5-a4d6-a855ab1939b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c06d742-2b05-4cf5-a4d6-a855ab1939b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e4933d-20e0-4938-badf-05a988719349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b978ede4754ba28273b432b75c6d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:30Z,use_quota=True,user_id='b6d7e6b2674f4a369b98b9869cd9c775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b48baa2-799a-4c5f-bdc0-bce40ffa7157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b48baa2-799a-4c5f-bdc0-bce40ffa7157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a540c2-33dc-4ede-a400-621146b48026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:30 devstack cinder-volume[88371]: DEBUG cinder.image.glance [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Creating Keystone auth plugin from conf {{(pid=88371) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 10:28:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a540c2-33dc-4ede-a400-621146b48026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77e4933d-20e0-4938-badf-05a988719349', 'volume_name': 'volume-77e4933d-20e0-4938-badf-05a988719349', 'volume_size': 1, 'image_id': '2ef6cb69-a896-47a8-bede-759641b744bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ef6cb69-a896-47a8-bede-759641b744bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '461708f076325a2b4a34fecc74b5f657', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71b978ede4754ba28273b432b75c6d63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3695a90007d8836a0a071792a5c53e7569feeb29efdb71a1ab8834f28d97be46fb825dce27c086139808a1297c5268b14f49481188ddaa3eb81186c86c9fdfaf', 'id': '2ef6cb69-a896-47a8-bede-759641b744bb', 'created_at': datetime.datetime(2026, 7, 23, 8, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 28, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ef6cb69-a896-47a8-bede-759641b744bb/file', 'properties': {}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cc707b-4fde-4f8e-ab00-c686a415ab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cc707b-4fde-4f8e-ab00-c686a415ab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7612b58a-5a1d-4315-b601-04f168e5fad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:31 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Volume 77e4933d-20e0-4938-badf-05a988719349: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77e4933d-20e0-4938-badf-05a988719349', 'volume_size': 1, 'image_id': '2ef6cb69-a896-47a8-bede-759641b744bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ef6cb69-a896-47a8-bede-759641b744bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '461708f076325a2b4a34fecc74b5f657', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71b978ede4754ba28273b432b75c6d63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3695a90007d8836a0a071792a5c53e7569feeb29efdb71a1ab8834f28d97be46fb825dce27c086139808a1297c5268b14f49481188ddaa3eb81186c86c9fdfaf', 'id': '2ef6cb69-a896-47a8-bede-759641b744bb', 'created_at': datetime.datetime(2026, 7, 23, 8, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 28, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ef6cb69-a896-47a8-bede-759641b744bb/file', 'properties': {}}, 'image_service': } Jul 23 10:28:31 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Trying to clone 77e4933d-20e0-4938-badf-05a988719349 from image 2ef6cb69-a896-47a8-bede-759641b744bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/2ef6cb69-a896-47a8-bede-759641b744bb', 'metadata': {}}]). {{(pid=88371) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 10:28:31 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 10:28:31 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Image download 0.00 MB at 0.00 MB/s Jul 23 10:28:31 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13fde6f-746b-418f-affd-93aee4bf20ff]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:31 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD Jul 23 10:28:31 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:32 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:32 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD Jul 23 10:28:32 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:32 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD" returned: 1 in 0.459s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:28:32 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Temporary image 2ef6cb69-a896-47a8-bede-759641b744bb is fetched for user b6d7e6b2674f4a369b98b9869cd9c775. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 10:28:32 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9ce574-d2d5-4880-9e78-98b11c2cd436]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:32 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD Jul 23 10:28:32 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:33 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD" returned: 0 in 0.748s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:33 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD Jul 23 10:28:33 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:34 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD" returned: 1 in 0.661s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e4933d-20e0-4938-badf-05a988719349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b978ede4754ba28273b432b75c6d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:30Z,use_quota=True,user_id='b6d7e6b2674f4a369b98b9869cd9c775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Creating volume 77e4933d-20e0-4938-badf-05a988719349 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:28:34 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:34 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 1073741824 Jul 23 10:28:34 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:34 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 1073741824" returned: 0 in 0.736s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:34 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 Jul 23 10:28:34 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:35 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349" returned: 0 in 0.376s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:28:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:35 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Attempting download of 2ef6cb69-a896-47a8-bede-759641b744bb ((None, [{'url': 'file:///opt/stack/data/glance/images/2ef6cb69-a896-47a8-bede-759641b744bb', 'metadata': {}}])) to volume 77e4933d-20e0-4938-badf-05a988719349. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 10:28:35 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f03d313-224c-43a5-b0db-5a68afb077b9]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ef6cb69-a896-47a8-bede-759641b744bb_3mqekzbo {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:35 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ef6cb69-a896-47a8-bede-759641b744bb_3mqekzbo Jul 23 10:28:35 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:35 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ef6cb69-a896-47a8-bede-759641b744bb_3mqekzbo" returned: 0 in 0.383s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ef6cb69-a896-47a8-bede-759641b744bb_3mqekzbo {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:36 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ef6cb69-a896-47a8-bede-759641b744bb_3mqekzbo Jul 23 10:28:36 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:36 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ef6cb69-a896-47a8-bede-759641b744bb_3mqekzbo" returned: 1 in 0.593s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ef6cb69-a896-47a8-bede-759641b744bb_3mqekzbo' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:28:36 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0e004e-ee79-4288-adc8-6fa052800343]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:36 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD Jul 23 10:28:36 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:36 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD" returned: 0 in 0.483s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Flow 'volume_create_manager' (2e9675f8-589b-4237-a5e8-1f554f6182c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d470c1-165c-4e8c-b4bb-03c7888294cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d470c1-165c-4e8c-b4bb-03c7888294cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1579936790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df04e064-89c1-4040-9946-51d1071c64ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048439a2ff0d4d3587407a24362ed86a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:37Z,use_quota=True,user_id='bf01c96563204a73ac5975d7fcbfdc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc4d3fb-c8bd-4f43-b83c-8f37e4fa79da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc4d3fb-c8bd-4f43-b83c-8f37e4fa79da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737ebf7e-3bbe-41aa-bea5-ce2312ffedbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737ebf7e-3bbe-41aa-bea5-ce2312ffedbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df04e064-89c1-4040-9946-51d1071c64ad', 'volume_name': 'volume-df04e064-89c1-4040-9946-51d1071c64ad', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf5b85b-9f7b-49d8-a1ec-bdc5eb2cc14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf5b85b-9f7b-49d8-a1ec-bdc5eb2cc14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28314034-4e3d-465c-9484-4b59588a1219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:37 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Volume df04e064-89c1-4040-9946-51d1071c64ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df04e064-89c1-4040-9946-51d1071c64ad', 'volume_size': 1} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1579936790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df04e064-89c1-4040-9946-51d1071c64ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048439a2ff0d4d3587407a24362ed86a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:37Z,use_quota=True,user_id='bf01c96563204a73ac5975d7fcbfdc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Creating volume df04e064-89c1-4040-9946-51d1071c64ad {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:28:37 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:37 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:28:37 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:37 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad 1073741824 Jul 23 10:28:37 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:37 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD" returned: 1 in 0.453s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] 2ef6cb69-a896-47a8-bede-759641b744bb was raw, converting to qcow2 {{(pid=88371) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:37 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 Jul 23 10:28:37 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:37 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad 1073741824" returned: 0 in 0.682s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:37 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad Jul 23 10:28:37 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:38 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349" returned: 0 in 0.672s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ef6cb69-a896-47a8-bede-759641b744bb_wn23bgm4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:28:38 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:38 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 1G Jul 23 10:28:38 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:38 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad" returned: 0 in 0.314s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28314034-4e3d-465c-9484-4b59588a1219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df04e064-89c1-4040-9946-51d1071c64ad', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1bb624-717c-4aab-a12a-a248902dee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:38 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Volume volume-df04e064-89c1-4040-9946-51d1071c64ad (df04e064-89c1-4040-9946-51d1071c64ad): created successfully Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1bb624-717c-4aab-a12a-a248902dee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Flow 'volume_create_manager' (2e9675f8-589b-4237-a5e8-1f554f6182c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:38 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0bfbacac-4f55-46d9-8122-e6440d1b5765 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Created volume successfully. Jul 23 10:28:38 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 1G" returned: 0 in 0.485s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Downloaded image 2ef6cb69-a896-47a8-bede-759641b744bb ((None, [{'url': 'file:///opt/stack/data/glance/images/2ef6cb69-a896-47a8-bede-759641b744bb', 'metadata': {}}])) to volume 77e4933d-20e0-4938-badf-05a988719349 successfully. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Temporary image 2ef6cb69-a896-47a8-bede-759641b744bb for user b6d7e6b2674f4a369b98b9869cd9c775 is deleted. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Marking volume 77e4933d-20e0-4938-badf-05a988719349 as bootable. {{(pid=88371) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Copying metadata from image 2ef6cb69-a896-47a8-bede-759641b744bb to 77e4933d-20e0-4938-badf-05a988719349. {{(pid=88371) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Creating volume glance metadata for volume 77e4933d-20e0-4938-badf-05a988719349 backed by image 2ef6cb69-a896-47a8-bede-759641b744bb with: {'image_id': '2ef6cb69-a896-47a8-bede-759641b744bb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '461708f076325a2b4a34fecc74b5f657', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88371) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7612b58a-5a1d-4315-b601-04f168e5fad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e4933d-20e0-4938-badf-05a988719349', 'volume_size': 1, 'image_id': '2ef6cb69-a896-47a8-bede-759641b744bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ef6cb69-a896-47a8-bede-759641b744bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '461708f076325a2b4a34fecc74b5f657', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71b978ede4754ba28273b432b75c6d63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3695a90007d8836a0a071792a5c53e7569feeb29efdb71a1ab8834f28d97be46fb825dce27c086139808a1297c5268b14f49481188ddaa3eb81186c86c9fdfaf', 'id': '2ef6cb69-a896-47a8-bede-759641b744bb', 'created_at': datetime.datetime(2026, 7, 23, 8, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 28, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ef6cb69-a896-47a8-bede-759641b744bb/file', 'properties': {}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df47ffac-2b9c-428b-8dce-50bd297cd64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:38 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Volume volume-77e4933d-20e0-4938-badf-05a988719349 (77e4933d-20e0-4938-badf-05a988719349): created successfully Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df47ffac-2b9c-428b-8dce-50bd297cd64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Flow 'volume_create_manager' (615dd588-83f2-45b3-a9ac-b7e388070810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:38 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-50ffd0f0-0ef3-45ed-b28b-fedffe83de8f tempest-VolumeImageDependencyTests-115482042 None] Created volume successfully. Jul 23 10:28:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Acquiring lock "cinder-77e4933d-20e0-4938-badf-05a988719349-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Lock "cinder-77e4933d-20e0-4938-badf-05a988719349-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:39 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Creating offline snapshot b25f3789-7f7e-4227-8d77-0ede351d7214 of volume df04e064-89c1-4040-9946-51d1071c64ad {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:28:39 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4743388-31e0-4a0a-8f24-266ee7bf1fc2]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Acquiring lock "cinder-quobyte-77e4933d-20e0-4938-badf-05a988719349" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Lock "cinder-quobyte-77e4933d-20e0-4938-badf-05a988719349" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:39 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b97d23-f2e9-45d8-b392-62da76635089]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:39 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad Jul 23 10:28:39 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:39 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 Jul 23 10:28:39 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:40 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad" returned: 0 in 0.487s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:40 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 1G Jul 23 10:28:40 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:40 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349" returned: 0 in 0.524s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:40 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349 Jul 23 10:28:40 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:40 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-77e4933d-20e0-4938-badf-05a988719349" returned: 0 in 0.298s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Lock "cinder-quobyte-77e4933d-20e0-4938-badf-05a988719349" released by "delete_volume" :: held 0.887s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Created reservations ['f636e202-ca40-4099-8a1e-8eac3f3dd4ff', '59068aff-5742-4283-8ce8-fb82c3ad2f8d', '4887b442-0173-4cb0-a542-6b004a934247', '36a86ccf-870c-4af8-a880-27f416c9c632'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:28:40 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 1G" returned: 0 in 0.575s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df04e064-89c1-4040-9946-51d1071c64ad -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:40 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df04e064-89c1-4040-9946-51d1071c64ad -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 Jul 23 10:28:40 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:40 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:28:40 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:41 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:41 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df04e064-89c1-4040-9946-51d1071c64ad -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214" returned: 0 in 0.596s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:41 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 is being set with open permissions: ugo+rw Jul 23 10:28:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.427s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:41 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:28:41 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Deleted volume successfully. Jul 23 10:28:41 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 Jul 23 10:28:41 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-489ecb78-c0b5-4af4-a3fe-4a9797f30f6d tempest-VolumeImageDependencyTests-115482042 None] Lock "cinder-77e4933d-20e0-4938-badf-05a988719349-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:41 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214" returned: 0 in 0.357s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:41 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.info Jul 23 10:28:41 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:42 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.info" returned: 0 in 0.422s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:42 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.info is being set with open permissions: ugo+rw Jul 23 10:28:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:42 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.info Jul 23 10:28:42 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:42 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.info" returned: 0 in 0.382s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.966s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:42 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-151a6f20-22b0-4a53-901b-53ab390e88f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Create snapshot completed successfully Jul 23 10:28:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Acquiring lock "cinder-b25f3789-7f7e-4227-8d77-0ede351d7214-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "cinder-b25f3789-7f7e-4227-8d77-0ede351d7214-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Acquiring lock "cinder-quobyte-df04e064-89c1-4040-9946-51d1071c64ad" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "cinder-quobyte-df04e064-89c1-4040-9946-51d1071c64ad" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Acquiring lock "cinder-quobyte-b25f3789-7f7e-4227-8d77-0ede351d7214" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "cinder-quobyte-b25f3789-7f7e-4227-8d77-0ede351d7214" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Deleting offline snapshot b25f3789-7f7e-4227-8d77-0ede351d7214 of volume df04e064-89c1-4040-9946-51d1071c64ad {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:28:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] snapshot_file for this snap is: volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:28:43 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53cd4c0-4a10-4d0b-aa9d-016692b29fdc]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:43 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 Jul 23 10:28:43 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:44 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214" returned: 0 in 0.438s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df04e064-89c1-4040-9946-51d1071c64ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:28:44 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9611ca51-f550-4716-93fe-021eabef154a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:44 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad Jul 23 10:28:44 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:44 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad" returned: 0 in 0.403s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:44 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 Jul 23 10:28:44 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:44 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214" returned: 0 in 0.419s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:44 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214 Jul 23 10:28:44 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:45 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad.b25f3789-7f7e-4227-8d77-0ede351d7214" returned: 0 in 0.265s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "cinder-quobyte-b25f3789-7f7e-4227-8d77-0ede351d7214" released by "_delete_snapshot" :: held 1.646s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "cinder-quobyte-df04e064-89c1-4040-9946-51d1071c64ad" released by "delete_snapshot" :: held 1.690s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=122,cinder:SELECT=107,cinder:INSERT=29,cinder:DELETE=6 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Created reservations ['2a4f5fb0-fc7e-4fc5-ad5a-432d96179d70', '3d1e9e7c-22aa-437f-b537-1aa422aba61c', '4789b7ed-bdf0-4eac-a5d4-c3bc0d55f717', '0e4063bc-b9b4-4b6b-b0c6-b04bbba3175b'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:28:45 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Delete snapshot completed successfully. Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b41325a6-3072-409c-ba02-76ca0c177315 tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "cinder-b25f3789-7f7e-4227-8d77-0ede351d7214-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Flow 'volume_create_manager' (27266308-1e1d-4984-b65e-f2f0c6f3a2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047fdcab-73eb-4cf2-9776-c0b487008bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Acquiring lock "cinder-df04e064-89c1-4040-9946-51d1071c64ad-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047fdcab-73eb-4cf2-9776-c0b487008bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480723704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4948e559-ff0a-455f-9f02-c7ec168c7fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6015b9fbf149b5a065ffe34d12344e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:46Z,use_quota=True,user_id='6d58727839a84b9b80eaab251928c561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d988ee7-2d3a-4c18-bc04-e468a6c0200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d988ee7-2d3a-4c18-bc04-e468a6c0200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df79625-9474-4a33-b0d7-5c207a533569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df79625-9474-4a33-b0d7-5c207a533569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4948e559-ff0a-455f-9f02-c7ec168c7fbd', 'volume_name': 'volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052069c5-1c2b-4eaf-8c61-7c499271949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052069c5-1c2b-4eaf-8c61-7c499271949a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a091b5e8-33a9-404e-b000-46df7df79a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:45 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Volume 4948e559-ff0a-455f-9f02-c7ec168c7fbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd', 'volume_size': 1} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480723704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4948e559-ff0a-455f-9f02-c7ec168c7fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6015b9fbf149b5a065ffe34d12344e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:46Z,use_quota=True,user_id='6d58727839a84b9b80eaab251928c561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Creating volume 4948e559-ff0a-455f-9f02-c7ec168c7fbd {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:28:45 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "cinder-df04e064-89c1-4040-9946-51d1071c64ad-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:45 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd 1073741824 Jul 23 10:28:45 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Acquiring lock "cinder-quobyte-df04e064-89c1-4040-9946-51d1071c64ad" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "cinder-quobyte-df04e064-89c1-4040-9946-51d1071c64ad" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb9d251-5331-4f17-88da-ffe60ea333b9]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:46 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad Jul 23 10:28:46 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:46 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd 1073741824" returned: 0 in 0.464s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:46 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:28:46 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:46 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad" returned: 0 in 0.391s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:46 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd Jul 23 10:28:46 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:46 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad Jul 23 10:28:46 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:46 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.303s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:28:46 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd" returned: 0 in 0.285s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a091b5e8-33a9-404e-b000-46df7df79a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:46 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12edc470-44f3-4b6e-ba03-09832f3f122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df04e064-89c1-4040-9946-51d1071c64ad" returned: 0 in 0.307s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "cinder-quobyte-df04e064-89c1-4040-9946-51d1071c64ad" released by "delete_volume" :: held 0.773s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:46 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Volume volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd (4948e559-ff0a-455f-9f02-c7ec168c7fbd): created successfully Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12edc470-44f3-4b6e-ba03-09832f3f122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Flow 'volume_create_manager' (27266308-1e1d-4984-b65e-f2f0c6f3a2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:46 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-edc904ac-05df-4951-9740-88e017e37cd0 tempest-ProjectReaderTests-1423658097 None] Created volume successfully. Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Created reservations ['9723a4aa-1d15-4e3f-ad06-e7bebb4c3fa8', '2e82881c-fa98-4bc5-8bc7-b7ddab070c72', '41aa84a1-c46e-44d9-a0bc-b16b4430e2c6', '1d4117f0-dee5-4edd-8696-307bbde6401c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:46 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:28:46 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:47 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.428s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:47 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:28:47 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Deleted volume successfully. Jul 23 10:28:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1feb34c-2a1b-4dc6-9528-8128efd4920b tempest-VolumeSnapshotQuotasNegativeTestJSON-704869454 None] Lock "cinder-df04e064-89c1-4040-9946-51d1071c64ad-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Acquiring lock "cinder-4948e559-ff0a-455f-9f02-c7ec168c7fbd-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Lock "cinder-4948e559-ff0a-455f-9f02-c7ec168c7fbd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Acquiring lock "cinder-quobyte-4948e559-ff0a-455f-9f02-c7ec168c7fbd" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Lock "cinder-quobyte-4948e559-ff0a-455f-9f02-c7ec168c7fbd" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:48 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae35704-c951-4463-8911-6a40f30e7e0a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:48 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd Jul 23 10:28:48 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:48 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd" returned: 0 in 0.435s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:48 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd Jul 23 10:28:48 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:48 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4948e559-ff0a-455f-9f02-c7ec168c7fbd" returned: 0 in 0.292s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Lock "cinder-quobyte-4948e559-ff0a-455f-9f02-c7ec168c7fbd" released by "delete_volume" :: held 0.779s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:49 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Created reservations ['30adadc3-d7b8-4b8b-abb3-4bd5e3ea4bc2', '04aa86fd-e086-46b8-be28-887da250bc3d', '48288162-a0a9-4b97-9af6-75075aca47c3', '5d9e2d69-c804-446f-b18d-138ac3eef39e'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:28:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:49 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:28:49 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:49 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.342s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:49 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:28:49 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Deleted volume successfully. Jul 23 10:28:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-341772dc-05f9-4656-b9e4-7aecfb1ab9f0 tempest-ProjectReaderTests-1423658097 None] Lock "cinder-4948e559-ff0a-455f-9f02-c7ec168c7fbd-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Flow 'volume_create_manager' (6b18ba27-8864-421e-9a05-e5d78c6dabd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32bb0bb1-06d8-4e04-9f8f-36c3a17421a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32bb0bb1-06d8-4e04-9f8f-36c3a17421a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1186471610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6015b9fbf149b5a065ffe34d12344e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:50Z,use_quota=True,user_id='6d58727839a84b9b80eaab251928c561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e209a93c-17d7-4db6-b789-e886988fde78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e209a93c-17d7-4db6-b789-e886988fde78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a68514-3ae2-4061-9cfb-b42cd2e2635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a68514-3ae2-4061-9cfb-b42cd2e2635d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb', 'volume_name': 'volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab717f9d-1158-4ed6-8631-eb1f128d1fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab717f9d-1158-4ed6-8631-eb1f128d1fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a24c179-e570-4116-bb74-e03ff38074a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:50 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Volume cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb', 'volume_size': 1} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1186471610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6015b9fbf149b5a065ffe34d12344e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:50Z,use_quota=True,user_id='6d58727839a84b9b80eaab251928c561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Creating volume cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:28:50 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:50 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb 1073741824 Jul 23 10:28:50 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:50 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb 1073741824" returned: 0 in 0.609s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:50 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb Jul 23 10:28:50 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:51 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb" returned: 0 in 0.428s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:28:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a24c179-e570-4116-bb74-e03ff38074a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64aee534-5db9-4ef0-b557-5de85c6e3826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:51 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Volume volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb (cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb): created successfully Jul 23 10:28:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64aee534-5db9-4ef0-b557-5de85c6e3826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Flow 'volume_create_manager' (6b18ba27-8864-421e-9a05-e5d78c6dabd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:51 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-469a8f0f-65bb-4ec4-89e6-89c7d642d96a tempest-ProjectReaderTests-1423658097 None] Created volume successfully. Jul 23 10:28:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Acquiring lock "cinder-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Lock "cinder-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Acquiring lock "cinder-quobyte-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:28:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Lock "cinder-quobyte-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:28:52 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d548afb-4b36-4212-829b-879aa848516a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:28:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:52 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb Jul 23 10:28:52 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:52 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb" returned: 0 in 0.508s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:52 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb Jul 23 10:28:52 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:53 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb" returned: 0 in 0.340s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Lock "cinder-quobyte-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb" released by "delete_volume" :: held 0.901s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Created reservations ['79d44b2a-b40d-4ca9-843b-e13cc3038a80', 'b7ef79b2-cbc7-457e-94c5-81c4a679f121', '78bab068-45ed-4c5f-8f0a-71a1455275ba', 'e7b8572f-cbf7-4483-8d0f-823fe38d1f24'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:53 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:28:53 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:53 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.303s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:28:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Deleted volume successfully. Jul 23 10:28:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d03e8ca2-d09e-4b17-9282-1f75ac262564 tempest-ProjectReaderTests-1423658097 None] Lock "cinder-cb4a849c-09c9-4e5c-8a0b-08aa4e25d9fb-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Flow 'volume_create_manager' (605dba0e-a2b9-422f-a399-302165a8d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e7f965-21c7-422f-ba55-98804b381ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e7f965-21c7-422f-ba55-98804b381ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-471039650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b83131-280a-401b-925d-72c03342f519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2758e78e00c943daba79fdfababca49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:55Z,use_quota=True,user_id='85ebb403d3234076aa99e0155c2b0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba47f6b-0e01-475a-aa36-8671906e3327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba47f6b-0e01-475a-aa36-8671906e3327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b40c8a6-52da-473d-ae9a-1a4cebe11568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b40c8a6-52da-473d-ae9a-1a4cebe11568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97b83131-280a-401b-925d-72c03342f519', 'volume_name': 'volume-97b83131-280a-401b-925d-72c03342f519', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e466c8e7-a870-46bb-861d-5360383b7627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e466c8e7-a870-46bb-861d-5360383b7627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbf6b66-2605-4fa9-8981-e2014bbff0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:54 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Volume 97b83131-280a-401b-925d-72c03342f519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97b83131-280a-401b-925d-72c03342f519', 'volume_size': 1} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-471039650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b83131-280a-401b-925d-72c03342f519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2758e78e00c943daba79fdfababca49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:28:55Z,use_quota=True,user_id='85ebb403d3234076aa99e0155c2b0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Creating volume 97b83131-280a-401b-925d-72c03342f519 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:28:55 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:55 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519 1073741824 Jul 23 10:28:55 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:55 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519 1073741824" returned: 0 in 0.542s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:28:55 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519 Jul 23 10:28:55 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:28:55 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519" returned: 0 in 0.304s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbf6b66-2605-4fa9-8981-e2014bbff0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97b83131-280a-401b-925d-72c03342f519', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92157dfb-8fed-40ae-9912-f7cede193989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:28:55 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Volume volume-97b83131-280a-401b-925d-72c03342f519 (97b83131-280a-401b-925d-72c03342f519): created successfully Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92157dfb-8fed-40ae-9912-f7cede193989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:28:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Flow 'volume_create_manager' (605dba0e-a2b9-422f-a399-302165a8d36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:28:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-965ea006-6c3a-4689-a95c-fa4fb990e922 tempest-AttachVolumeNegativeTest-1247823510 None] Created volume successfully. Jul 23 10:28:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-0ac5e3cd-47d0-4df4-99c3-71d6fc1ee9fc req-cfcdb0f8-d5f1-420c-879d-a58e086cd0e5 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:28:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-0ac5e3cd-47d0-4df4-99c3-71d6fc1ee9fc req-cfcdb0f8-d5f1-420c-879d-a58e086cd0e5 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:28:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-0ac5e3cd-47d0-4df4-99c3-71d6fc1ee9fc req-cfcdb0f8-d5f1-420c-879d-a58e086cd0e5 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:28:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-0ac5e3cd-47d0-4df4-99c3-71d6fc1ee9fc req-cfcdb0f8-d5f1-420c-879d-a58e086cd0e5 tempest-AttachVolumeNegativeTest-1247823510 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-97b83131-280a-401b-925d-72c03342f519', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '445b9720-bba9-4e4e-8142-df1f820a56ef', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:28:58 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-0ac5e3cd-47d0-4df4-99c3-71d6fc1ee9fc req-cfcdb0f8-d5f1-420c-879d-a58e086cd0e5 tempest-AttachVolumeNegativeTest-1247823510 None] attachment_update completed successfully. Jul 23 10:29:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-1ce4faf3-9bde-4c63-b13e-1ddeccace563 req-8dfd7064-a5b2-45c5-b255-df4f9ec60eff tempest-AttachVolumeNegativeTest-1247823510 None] Terminate volume connection completed successfully. Jul 23 10:29:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-1ce4faf3-9bde-4c63-b13e-1ddeccace563 req-8dfd7064-a5b2-45c5-b255-df4f9ec60eff tempest-AttachVolumeNegativeTest-1247823510 None] Deleting attachment 445b9720-bba9-4e4e-8142-df1f820a56ef. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:29:08 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:INSERT=10,cinder:UPDATE=41,cinder:SELECT=26,cinder:DELETE=1 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:29:11 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=60,cinder:INSERT=18,cinder:UPDATE=52,cinder:DELETE=8 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:29:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "cinder-97b83131-280a-401b-925d-72c03342f519-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-97b83131-280a-401b-925d-72c03342f519-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "cinder-quobyte-97b83131-280a-401b-925d-72c03342f519" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-quobyte-97b83131-280a-401b-925d-72c03342f519" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb4806f-268e-46cb-87ee-9e79f6445f97]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:14 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519 Jul 23 10:29:14 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:14 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519" returned: 0 in 0.514s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:29:14 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519 Jul 23 10:29:14 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Flow 'volume_create_manager' (65565a1f-989d-491f-9665-df32180ef881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca45d03-33f9-4abb-9262-51d21a5e5c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca45d03-33f9-4abb-9262-51d21a5e5c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1827058277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974b9502-4946-45d8-b823-c7c47cda58d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d52954249e146adb4521eba2633f775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:15Z,use_quota=True,user_id='bc2a7afed5574443ada8e5d3127584ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618e1821-6bda-401f-ab14-406b250e31be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618e1821-6bda-401f-ab14-406b250e31be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea9ad5a-9faa-4de2-b467-1324c851f71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.image.glance [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Creating Keystone auth plugin from conf {{(pid=88371) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 10:29:14 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97b83131-280a-401b-925d-72c03342f519" returned: 0 in 0.324s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-quobyte-97b83131-280a-401b-925d-72c03342f519" released by "delete_volume" :: held 0.902s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Created reservations ['3cd0530b-ff18-4e12-926a-6f82e6e7b54b', 'fdc2b846-5509-4051-b034-82ce858bb03e', 'a497a78b-7401-436e-a2e2-a38719d43bf6', '4b3dc35e-f835-4d6f-91c8-8406015cd388'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:15 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:29:15 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea9ad5a-9faa-4de2-b467-1324c851f71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '974b9502-4946-45d8-b823-c7c47cda58d2', 'volume_name': 'volume-974b9502-4946-45d8-b823-c7c47cda58d2', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a567d9-51d9-419f-91e2-7156a741bbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a567d9-51d9-419f-91e2-7156a741bbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21bdb34-400d-41c1-aa92-a92737e62b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:15 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Volume 974b9502-4946-45d8-b823-c7c47cda58d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-974b9502-4946-45d8-b823-c7c47cda58d2', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Trying to clone 974b9502-4946-45d8-b823-c7c47cda58d2 from image c7e93a9b-febb-49a8-91b3-5378e004c880 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]). {{(pid=88371) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "cinder-bdbf5289-28ba-43a9-bc84-a651c8f2631e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-bdbf5289-28ba-43a9-bc84-a651c8f2631e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "cinder-quobyte-bdbf5289-28ba-43a9-bc84-a651c8f2631e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-quobyte-bdbf5289-28ba-43a9-bc84-a651c8f2631e" acquired by "delete_volume" :: waited 0.065s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:15 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.487s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:29:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Deleted volume successfully. Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d60bc23-32d4-429e-99e0-abd4f54fd14e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f3575ec1-131b-491b-91c0-cc772a67e9b3 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-97b83131-280a-401b-925d-72c03342f519-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:15 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e Jul 23 10:29:15 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 10:29:15 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Image download 20.69 MB at 20.69 MB/s Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b18555c-215d-4619-802c-136fd739a359]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:16 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD Jul 23 10:29:16 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:16 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e" returned: 0 in 0.636s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:16 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e Jul 23 10:29:16 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:16 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD" returned: 0 in 0.601s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Temporary image c7e93a9b-febb-49a8-91b3-5378e004c880 is fetched for user bc2a7afed5574443ada8e5d3127584ef. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 10:29:16 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bdbf5289-28ba-43a9-bc84-a651c8f2631e" returned: 0 in 0.375s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-quobyte-bdbf5289-28ba-43a9-bc84-a651c8f2631e" released by "delete_volume" :: held 1.130s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[69911aaf-c201-4553-a255-50ecb7394bcf]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Created reservations ['d35c5fdf-c275-4c18-bef4-c04cb408eccf', 'dfec589e-3781-4474-804a-5905690448d8', 'bb192db5-a27c-4202-ac9d-16d2a22c823d', 'a5562b40-c3db-4c6e-a65b-8e5dab35fe6c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:17 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD Jul 23 10:29:17 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:17 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:29:17 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:17 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1827058277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974b9502-4946-45d8-b823-c7c47cda58d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d52954249e146adb4521eba2633f775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:15Z,use_quota=True,user_id='bc2a7afed5574443ada8e5d3127584ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Creating volume 974b9502-4946-45d8-b823-c7c47cda58d2 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:29:17 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:17 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 1073741824 Jul 23 10:29:17 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:17 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.368s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:29:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Deleted volume successfully. Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9608c363-60f3-4270-bfc8-a373a0ab77d9 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-bdbf5289-28ba-43a9-bc84-a651c8f2631e-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "cinder-8b325613-835e-441d-b911-085f8ee5a403-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-8b325613-835e-441d-b911-085f8ee5a403-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:18 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 1073741824" returned: 0 in 0.726s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "cinder-quobyte-8b325613-835e-441d-b911-085f8ee5a403" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-quobyte-8b325613-835e-441d-b911-085f8ee5a403" acquired by "delete_volume" :: waited 0.030s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e79fb5-35eb-4076-b658-725695271546]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:18 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 Jul 23 10:29:18 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:18 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403 Jul 23 10:29:18 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:18 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2" returned: 0 in 0.420s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Attempting download of c7e93a9b-febb-49a8-91b3-5378e004c880 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}])) to volume 974b9502-4946-45d8-b823-c7c47cda58d2. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d7fde-779b-43ee-a52c-b6fbbf6d900a]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_8gt6gphk {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:18 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403" returned: 0 in 0.623s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:18 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403 Jul 23 10:29:18 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:18 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_8gt6gphk Jul 23 10:29:18 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:19 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8b325613-835e-441d-b911-085f8ee5a403" returned: 0 in 0.338s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-quobyte-8b325613-835e-441d-b911-085f8ee5a403" released by "delete_volume" :: held 1.064s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Created reservations ['b8b86e72-55b4-4c94-a871-919ffe4d8f85', '58864bda-ef44-4d5e-bf2c-23bdf94c06b2', '9498d065-861d-48af-86bb-76a5b940a96c', 'd801c51a-2448-413b-b551-248341c4c0af'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:29:19 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_8gt6gphk" returned: 0 in 0.563s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_8gt6gphk {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:19 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:29:19 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:19 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_8gt6gphk Jul 23 10:29:19 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:19 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.396s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:29:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Deleted volume successfully. Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f93d3d73-765a-49a1-83ca-147d3534cdf6 tempest-AttachVolumeNegativeTest-1247823510 None] Lock "cinder-8b325613-835e-441d-b911-085f8ee5a403-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:19 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_8gt6gphk" returned: 1 in 0.570s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_8gt6gphk' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc77f81-f32d-4284-8cc3-e446b94b8a12]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:19 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD Jul 23 10:29:19 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:20 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:20 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] c7e93a9b-febb-49a8-91b3-5378e004c880 was qcow2, converting to qcow2 {{(pid=88371) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 10:29:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:20 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 Jul 23 10:29:20 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:22 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2" returned: 0 in 2.552s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:22 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_d_wnnf86devstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:29:22 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Converted 112.00 MB image at 43.86 MB/s Jul 23 10:29:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:22 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 1G Jul 23 10:29:22 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:23 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 1G" returned: 0 in 0.385s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:23 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Downloaded image c7e93a9b-febb-49a8-91b3-5378e004c880 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}])) to volume 974b9502-4946-45d8-b823-c7c47cda58d2 successfully. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 10:29:23 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Temporary image c7e93a9b-febb-49a8-91b3-5378e004c880 for user bc2a7afed5574443ada8e5d3127584ef is deleted. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 10:29:23 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Marking volume 974b9502-4946-45d8-b823-c7c47cda58d2 as bootable. {{(pid=88371) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 10:29:23 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Copying metadata from image c7e93a9b-febb-49a8-91b3-5378e004c880 to 974b9502-4946-45d8-b823-c7c47cda58d2. {{(pid=88371) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 10:29:23 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Creating volume glance metadata for volume 974b9502-4946-45d8-b823-c7c47cda58d2 backed by image c7e93a9b-febb-49a8-91b3-5378e004c880 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88371) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 10:29:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21bdb34-400d-41c1-aa92-a92737e62b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974b9502-4946-45d8-b823-c7c47cda58d2', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c449a6d2-8ad8-4dc1-b1c1-5b2173a68f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:23 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Volume volume-974b9502-4946-45d8-b823-c7c47cda58d2 (974b9502-4946-45d8-b823-c7c47cda58d2): created successfully Jul 23 10:29:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c449a6d2-8ad8-4dc1-b1c1-5b2173a68f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Flow 'volume_create_manager' (65565a1f-989d-491f-9665-df32180ef881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:23 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fa65990b-ce0e-4ba9-9237-67f380715bb5 tempest-TestShelveInstance-924719463 None] Created volume successfully. Jul 23 10:29:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-6ab46289-356f-4f2c-8387-b6bdbb5a37b9 req-4d997a00-50df-44e8-9cbe-7a8be9434fa1 tempest-TestShelveInstance-924719463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-6ab46289-356f-4f2c-8387-b6bdbb5a37b9 req-4d997a00-50df-44e8-9cbe-7a8be9434fa1 tempest-TestShelveInstance-924719463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-6ab46289-356f-4f2c-8387-b6bdbb5a37b9 req-4d997a00-50df-44e8-9cbe-7a8be9434fa1 tempest-TestShelveInstance-924719463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-6ab46289-356f-4f2c-8387-b6bdbb5a37b9 req-4d997a00-50df-44e8-9cbe-7a8be9434fa1 tempest-TestShelveInstance-924719463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-974b9502-4946-45d8-b823-c7c47cda58d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da19c7f9-901f-4da6-b62f-61a63f8d08e8', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:29:27 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-6ab46289-356f-4f2c-8387-b6bdbb5a37b9 req-4d997a00-50df-44e8-9cbe-7a8be9434fa1 tempest-TestShelveInstance-924719463 None] attachment_update completed successfully. Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Flow 'volume_create_manager' (9d3b4d00-6335-4232-9fcd-56f4f866cd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215941d2-5ddc-4f60-ad21-ed3c5335c4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215941d2-5ddc-4f60-ad21-ed3c5335c4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1947891432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06405f63-8e13-4b4d-a8f0-f1462082b927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178875d6589849b9bcf609cb1266f47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:32Z,use_quota=True,user_id='cb0fbe61ab05482eba6af1beffb42614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9553eb85-b080-48aa-81f5-b0baa230cdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9553eb85-b080-48aa-81f5-b0baa230cdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f308b56-9e0b-41ed-975f-1e4f7fe22fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f308b56-9e0b-41ed-975f-1e4f7fe22fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06405f63-8e13-4b4d-a8f0-f1462082b927', 'volume_name': 'volume-06405f63-8e13-4b4d-a8f0-f1462082b927', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99586149-e337-4d4c-a83e-3e8d928f42b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99586149-e337-4d4c-a83e-3e8d928f42b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40913783-97ea-44a9-90e2-6b142dcc766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:31 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Volume 06405f63-8e13-4b4d-a8f0-f1462082b927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06405f63-8e13-4b4d-a8f0-f1462082b927', 'volume_size': 1} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1947891432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06405f63-8e13-4b4d-a8f0-f1462082b927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178875d6589849b9bcf609cb1266f47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:32Z,use_quota=True,user_id='cb0fbe61ab05482eba6af1beffb42614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Creating volume 06405f63-8e13-4b4d-a8f0-f1462082b927 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:29:31 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:29:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:32 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 1073741824 Jul 23 10:29:32 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:32 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 1073741824" returned: 0 in 1.098s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:33 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 Jul 23 10:29:33 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:33 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927" returned: 0 in 0.373s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:29:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40913783-97ea-44a9-90e2-6b142dcc766b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06405f63-8e13-4b4d-a8f0-f1462082b927', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef821466-18a8-4e93-8ba1-454b5be06116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:33 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Volume volume-06405f63-8e13-4b4d-a8f0-f1462082b927 (06405f63-8e13-4b4d-a8f0-f1462082b927): created successfully Jul 23 10:29:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef821466-18a8-4e93-8ba1-454b5be06116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Flow 'volume_create_manager' (9d3b4d00-6335-4232-9fcd-56f4f866cd22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:33 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-09745275-032f-47e7-8ff7-f57375db323c req-0daf2346-6713-4264-9d6a-8881f375467e tempest-VolumesSnapshotsTestJSON-713782477 None] Created volume successfully. Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (681f7fba-a67c-4f9f-aa1f-45c406c7ddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55845f30-4461-4f32-9487-f625c0209170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] Creating offline snapshot 2506e019-e6b8-488e-8330-8286b7d70f0a of volume 06405f63-8e13-4b4d-a8f0-f1462082b927 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55845f30-4461-4f32-9487-f625c0209170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323692309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91eba9d-3946-4a3d-9a15-98bedfb0939d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:35Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee446e1b-2e72-4521-a638-b33c62f0af05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee446e1b-2e72-4521-a638-b33c62f0af05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26e6737-6c0c-4dc1-8b6e-34c79a505d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26e6737-6c0c-4dc1-8b6e-34c79a505d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91eba9d-3946-4a3d-9a15-98bedfb0939d', 'volume_name': 'volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fde91f-844b-422c-99f4-3704956f9c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fde91f-844b-422c-99f4-3704956f9c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcda493-c2bc-4db0-8f4a-cc53eaf739ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:34 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Volume e91eba9d-3946-4a3d-9a15-98bedfb0939d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d', 'volume_size': 1} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab359f85-fe19-4ce0-a798-4b8e1a3986f9]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:34 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 Jul 23 10:29:34 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:35 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927" returned: 0 in 0.382s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:35 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a 1G Jul 23 10:29:35 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:35 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a 1G" returned: 0 in 0.594s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06405f63-8e13-4b4d-a8f0-f1462082b927 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:35 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06405f63-8e13-4b4d-a8f0-f1462082b927 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a Jul 23 10:29:35 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:36 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06405f63-8e13-4b4d-a8f0-f1462082b927 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a" returned: 0 in 0.428s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:36 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a is being set with open permissions: ugo+rw Jul 23 10:29:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:36 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a Jul 23 10:29:36 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:36 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a" returned: 0 in 0.290s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:36 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.info Jul 23 10:29:36 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:36 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.info" returned: 0 in 0.280s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:36 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.info is being set with open permissions: ugo+rw Jul 23 10:29:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:36 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.info Jul 23 10:29:36 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:37 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.info" returned: 0 in 0.384s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.571s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.452s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323692309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91eba9d-3946-4a3d-9a15-98bedfb0939d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:35Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Creating volume e91eba9d-3946-4a3d-9a15-98bedfb0939d {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:29:37 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:29:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:37 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d 1073741824 Jul 23 10:29:37 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:37 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-aa084761-b3da-4f06-9938-08271fb83dda req-7f0fe0ca-572a-4516-8e06-65d83fc451c1 tempest-VolumesSnapshotsTestJSON-713782477 None] Create snapshot completed successfully Jul 23 10:29:38 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d 1073741824" returned: 0 in 0.696s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:38 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d Jul 23 10:29:38 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Acquiring lock "cinder-2506e019-e6b8-488e-8330-8286b7d70f0a-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "cinder-2506e019-e6b8-488e-8330-8286b7d70f0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Acquiring lock "cinder-quobyte-06405f63-8e13-4b4d-a8f0-f1462082b927" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "cinder-quobyte-06405f63-8e13-4b4d-a8f0-f1462082b927" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Acquiring lock "cinder-quobyte-2506e019-e6b8-488e-8330-8286b7d70f0a" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:38 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "cinder-quobyte-2506e019-e6b8-488e-8330-8286b7d70f0a" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Deleting offline snapshot 2506e019-e6b8-488e-8330-8286b7d70f0a of volume 06405f63-8e13-4b4d-a8f0-f1462082b927 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] snapshot_file for this snap is: volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d" returned: 0 in 0.467s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[756ad6a3-5830-49dd-8b19-1eeec7300925]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcda493-c2bc-4db0-8f4a-cc53eaf739ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6bd144-3fa8-49c9-abad-2e79c8a97b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:38 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Volume volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d (e91eba9d-3946-4a3d-9a15-98bedfb0939d): created successfully Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6bd144-3fa8-49c9-abad-2e79c8a97b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (681f7fba-a67c-4f9f-aa1f-45c406c7ddf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:38 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-264da4b7-c86a-45b4-be72-73a2357c93c0 tempest-VolumesActionsTest-1087494014 None] Created volume successfully. Jul 23 10:29:38 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a Jul 23 10:29:38 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d58130e7-f11b-46ec-a9b0-f368c236bb19 tempest-VolumesActionsTest-1087494014 None] Acquiring lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d" by "attach_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d58130e7-f11b-46ec-a9b0-f368c236bb19 tempest-VolumesActionsTest-1087494014 None] Lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d" acquired by "attach_volume" :: waited 0.041s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:39 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d58130e7-f11b-46ec-a9b0-f368c236bb19 tempest-VolumesActionsTest-1087494014 None] Attaching volume e91eba9d-3946-4a3d-9a15-98bedfb0939d to instance 5bec75b1-6f46-4a48-a2e7-86be01c865bc at mountpoint /dev/vdb on host None. Jul 23 10:29:39 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d58130e7-f11b-46ec-a9b0-f368c236bb19 tempest-VolumesActionsTest-1087494014 None] Attach volume completed successfully. Jul 23 10:29:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d58130e7-f11b-46ec-a9b0-f368c236bb19 tempest-VolumesActionsTest-1087494014 None] Lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d" released by "attach_volume" :: held 0.247s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:39 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a" returned: 0 in 0.750s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:39 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06405f63-8e13-4b4d-a8f0-f1462082b927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:29:39 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[53deba57-ecdb-41c0-bca2-d9b99d78cae4]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:39 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 Jul 23 10:29:39 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:40 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927" returned: 0 in 0.933s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:40 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a Jul 23 10:29:40 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:40 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-86b5c085-a120-4376-acfd-f03be3849f09 tempest-VolumesActionsTest-1153985151 None] Terminate volume connection completed successfully. Jul 23 10:29:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-86b5c085-a120-4376-acfd-f03be3849f09 tempest-VolumesActionsTest-1153985151 None] Acquiring lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d-detach_volume" by "detach_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-86b5c085-a120-4376-acfd-f03be3849f09 tempest-VolumesActionsTest-1153985151 None] Lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d-detach_volume" acquired by "detach_volume" :: waited 0.060s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:40 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-86b5c085-a120-4376-acfd-f03be3849f09 tempest-VolumesActionsTest-1153985151 None] Detaching volume e91eba9d-3946-4a3d-9a15-98bedfb0939d from instance 5bec75b1-6f46-4a48-a2e7-86be01c865bc. Jul 23 10:29:40 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-86b5c085-a120-4376-acfd-f03be3849f09 tempest-VolumesActionsTest-1153985151 None] Detach volume completed successfully. Jul 23 10:29:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-86b5c085-a120-4376-acfd-f03be3849f09 tempest-VolumesActionsTest-1153985151 None] Lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d-detach_volume" released by "detach_volume" :: held 0.183s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d4321bd9-0bfd-4136-bfa9-d8c8a2ea5dc8 tempest-VolumesActionsTest-1087494014 None] Acquiring lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d-detach_volume" by "detach_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d4321bd9-0bfd-4136-bfa9-d8c8a2ea5dc8 tempest-VolumesActionsTest-1087494014 None] Lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:41 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d4321bd9-0bfd-4136-bfa9-d8c8a2ea5dc8 tempest-VolumesActionsTest-1087494014 None] Volume detach called, but volume not attached. Jul 23 10:29:41 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d4321bd9-0bfd-4136-bfa9-d8c8a2ea5dc8 tempest-VolumesActionsTest-1087494014 None] Lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a" returned: 0 in 0.851s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:41 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a Jul 23 10:29:41 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Acquiring lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:41 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927.2506e019-e6b8-488e-8330-8286b7d70f0a" returned: 0 in 0.509s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Acquiring lock "cinder-quobyte-e91eba9d-3946-4a3d-9a15-98bedfb0939d" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "cinder-quobyte-2506e019-e6b8-488e-8330-8286b7d70f0a" released by "_delete_snapshot" :: held 3.251s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "cinder-quobyte-06405f63-8e13-4b4d-a8f0-f1462082b927" released by "delete_snapshot" :: held 3.312s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Lock "cinder-quobyte-e91eba9d-3946-4a3d-9a15-98bedfb0939d" acquired by "delete_volume" :: waited 0.049s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[420bcc99-7a19-4e65-8d53-3f77408b115d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:42 devstack cinder-volume[88371]: DEBUG cinder.quota [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Created reservations ['84a80dc6-3ba2-46dc-8f0e-3ff238bcc1e1', '60dee3ce-e652-4522-8e50-5c646bda7f1c', '04aa6888-305c-4b4c-91c7-f808c34fc393', 'a92bc315-0727-4bb1-a270-ab4351e4e1c6'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:29:42 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Delete snapshot completed successfully. Jul 23 10:29:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-802a852e-9667-46d9-b92d-25fe4346125b req-70fdff15-7db4-4acd-a0c1-b59777eba3c2 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "cinder-2506e019-e6b8-488e-8330-8286b7d70f0a-delete_snapshot" released by "delete_snapshot" :: held 3.669s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:42 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d Jul 23 10:29:42 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:42 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d" returned: 0 in 0.602s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:42 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d Jul 23 10:29:42 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:42 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e91eba9d-3946-4a3d-9a15-98bedfb0939d" returned: 0 in 0.354s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Lock "cinder-quobyte-e91eba9d-3946-4a3d-9a15-98bedfb0939d" released by "delete_volume" :: held 1.048s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:42 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Created reservations ['2acb6782-88fc-4f88-842e-995b5654a2e0', 'c6eedc6c-7bc5-4040-be0f-116945dcd617', '35226e95-e653-4c40-9e43-fa8f7866e8e6', '25dd6bab-6524-4a91-839b-8d36100e31c6'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:29:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:43 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:29:43 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Acquiring lock "cinder-06405f63-8e13-4b4d-a8f0-f1462082b927-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "cinder-06405f63-8e13-4b4d-a8f0-f1462082b927-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Acquiring lock "cinder-quobyte-06405f63-8e13-4b4d-a8f0-f1462082b927" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "cinder-quobyte-06405f63-8e13-4b4d-a8f0-f1462082b927" acquired by "delete_volume" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:43 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.368s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:29:43 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Deleted volume successfully. Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde1b4a6-7dd1-4db1-8394-c24b129f46b4]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f4d1fbef-5951-40e9-90ef-322935cc5af0 tempest-VolumesActionsTest-1087494014 None] Lock "cinder-e91eba9d-3946-4a3d-9a15-98bedfb0939d-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:43 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 Jul 23 10:29:43 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:43 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927" returned: 0 in 0.443s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:43 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927 Jul 23 10:29:43 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:44 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-06405f63-8e13-4b4d-a8f0-f1462082b927" returned: 0 in 0.405s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "cinder-quobyte-06405f63-8e13-4b4d-a8f0-f1462082b927" released by "delete_volume" :: held 0.932s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:44 devstack cinder-volume[88371]: DEBUG cinder.quota [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Created reservations ['66e8398e-32ac-45c5-98f6-7cc01eb472df', '9da36852-4860-49d6-af7e-e087eabb97a9', 'e7e914c9-3af2-43bf-b0ed-bbcc6f9b6483', '23caa8c0-6f21-4dea-815b-dfb85131e604'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:29:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:44 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:29:44 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:44 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.549s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:44 devstack cinder-volume[88371]: DEBUG cinder.manager [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:29:44 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Deleted volume successfully. Jul 23 10:29:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-5cc8ff39-7a52-42c7-b146-4fa170671faf req-03e9fd49-db34-440a-94af-2135a0f78a81 tempest-VolumesSnapshotsTestJSON-713782477 None] Lock "cinder-06405f63-8e13-4b4d-a8f0-f1462082b927-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:46 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:29:46 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:46 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.322s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:29:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (6550d7df-25e1-4ed5-99f8-846335485950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848a0019-4ffe-4631-b302-1693df8a7e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848a0019-4ffe-4631-b302-1693df8a7e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1580271235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d773c438-d346-45ab-82b6-851bc12cccd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:47Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988bacdc-ba66-4f89-9115-0548247c844b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988bacdc-ba66-4f89-9115-0548247c844b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69c1856-0b0d-403d-b5d9-d9a2fecac555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69c1856-0b0d-403d-b5d9-d9a2fecac555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd773c438-d346-45ab-82b6-851bc12cccd9', 'volume_name': 'volume-d773c438-d346-45ab-82b6-851bc12cccd9', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90924ca5-6f4f-4f54-b93d-8f420f2b3faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90924ca5-6f4f-4f54-b93d-8f420f2b3faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a787c1-6b34-4299-9aba-b347f0c54f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:47 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Volume d773c438-d346-45ab-82b6-851bc12cccd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d773c438-d346-45ab-82b6-851bc12cccd9', 'volume_size': 1} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1580271235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d773c438-d346-45ab-82b6-851bc12cccd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:47Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Creating volume d773c438-d346-45ab-82b6-851bc12cccd9 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:29:47 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:29:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:47 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9 1073741824 Jul 23 10:29:47 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:48 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9 1073741824" returned: 0 in 0.506s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:48 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9 Jul 23 10:29:48 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:48 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9" returned: 0 in 0.289s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:29:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a787c1-6b34-4299-9aba-b347f0c54f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d773c438-d346-45ab-82b6-851bc12cccd9', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad4ccd5-b6fa-45aa-8645-06fb61f501a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:48 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Volume volume-d773c438-d346-45ab-82b6-851bc12cccd9 (d773c438-d346-45ab-82b6-851bc12cccd9): created successfully Jul 23 10:29:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad4ccd5-b6fa-45aa-8645-06fb61f501a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (6550d7df-25e1-4ed5-99f8-846335485950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:48 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5a0d9f1e-d4dc-433a-9d27-86ce464c388b tempest-VolumesActionsTest-1087494014 None] Created volume successfully. Jul 23 10:29:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Acquiring lock "cinder-d773c438-d346-45ab-82b6-851bc12cccd9-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Lock "cinder-d773c438-d346-45ab-82b6-851bc12cccd9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Acquiring lock "cinder-quobyte-d773c438-d346-45ab-82b6-851bc12cccd9" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Lock "cinder-quobyte-d773c438-d346-45ab-82b6-851bc12cccd9" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:49 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54dc083-c5c1-4bc3-8690-089bb69fb328]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:49 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9 Jul 23 10:29:49 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:50 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9" returned: 0 in 0.408s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:50 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9 Jul 23 10:29:50 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:50 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d773c438-d346-45ab-82b6-851bc12cccd9" returned: 0 in 0.268s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Lock "cinder-quobyte-d773c438-d346-45ab-82b6-851bc12cccd9" released by "delete_volume" :: held 0.740s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:50 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Created reservations ['691cdb92-caf8-4d69-a64f-7509711cc262', '1f8b3601-bd22-42ee-8184-51587a86bb18', '3b1a1f95-7086-426d-a1ca-4f2e536ebd2e', '8fd8ca99-1c61-4138-81d1-2dbe829cfaaf'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:29:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:50 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:29:50 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:51 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.289s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:29:51 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Deleted volume successfully. Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e7b2f392-1848-4ddf-8b8b-27dd63bb033b tempest-VolumesActionsTest-1153985151 None] Lock "cinder-d773c438-d346-45ab-82b6-851bc12cccd9-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (a0121ec5-8ab3-41bf-924d-81da7742940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6b6d1e-0f95-4c5a-8d83-71a391823e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6b6d1e-0f95-4c5a-8d83-71a391823e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1064732181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02ed443-7de9-465f-aa55-f14032d0a5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:52Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb482eb8-596f-40fc-8228-86aeaeefe2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb482eb8-596f-40fc-8228-86aeaeefe2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615ea3dd-9c31-4377-8a02-46efc5706227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615ea3dd-9c31-4377-8a02-46efc5706227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a02ed443-7de9-465f-aa55-f14032d0a5ed', 'volume_name': 'volume-a02ed443-7de9-465f-aa55-f14032d0a5ed', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e29394-de30-4942-8138-f6a1de6d02ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e29394-de30-4942-8138-f6a1de6d02ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ee9194-9887-43c7-813d-6b4ef7232e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:51 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Volume a02ed443-7de9-465f-aa55-f14032d0a5ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a02ed443-7de9-465f-aa55-f14032d0a5ed', 'volume_size': 1} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1064732181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02ed443-7de9-465f-aa55-f14032d0a5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:52Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Creating volume a02ed443-7de9-465f-aa55-f14032d0a5ed {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:29:51 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:29:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:51 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed 1073741824 Jul 23 10:29:51 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:52 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed 1073741824" returned: 0 in 0.602s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:52 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed Jul 23 10:29:52 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:52 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed" returned: 0 in 0.278s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:29:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ee9194-9887-43c7-813d-6b4ef7232e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02ed443-7de9-465f-aa55-f14032d0a5ed', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe8acff-3cbf-4f44-91e6-7a5240fdb665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:52 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Volume volume-a02ed443-7de9-465f-aa55-f14032d0a5ed (a02ed443-7de9-465f-aa55-f14032d0a5ed): created successfully Jul 23 10:29:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe8acff-3cbf-4f44-91e6-7a5240fdb665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (a0121ec5-8ab3-41bf-924d-81da7742940f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:52 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-78fb08fa-c7b1-4bb4-80a3-2d7fcdd49d09 tempest-VolumesActionsTest-1087494014 None] Created volume successfully. Jul 23 10:29:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-af756a53-84d5-4634-a4cf-cce0f66e9672 tempest-GroupSnapshotsTest-1339401078 None] Group tempest-GroupSnapshotsTest-Group-996298450: creating Jul 23 10:29:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-af756a53-84d5-4634-a4cf-cce0f66e9672 tempest-GroupSnapshotsTest-1339401078 None] Group tempest-GroupSnapshotsTest-Group-996298450: created successfully Jul 23 10:29:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-af756a53-84d5-4634-a4cf-cce0f66e9672 tempest-GroupSnapshotsTest-1339401078 None] Create group completed successfully. Jul 23 10:29:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Acquiring lock "cinder-a02ed443-7de9-465f-aa55-f14032d0a5ed-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Lock "cinder-a02ed443-7de9-465f-aa55-f14032d0a5ed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Acquiring lock "cinder-quobyte-a02ed443-7de9-465f-aa55-f14032d0a5ed" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Lock "cinder-quobyte-a02ed443-7de9-465f-aa55-f14032d0a5ed" acquired by "delete_volume" :: waited 0.013s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfd0bee-b06f-43dd-a7e1-b8951e555fbd]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:53 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed Jul 23 10:29:53 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:54 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed" returned: 0 in 0.347s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:54 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed Jul 23 10:29:54 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:54 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a02ed443-7de9-465f-aa55-f14032d0a5ed" returned: 0 in 0.259s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Lock "cinder-quobyte-a02ed443-7de9-465f-aa55-f14032d0a5ed" released by "delete_volume" :: held 0.646s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Created reservations ['2a1d88e3-4ff4-44b6-9aa8-92c1d5b9f5a5', '55f62a05-a9cc-408c-97e1-b1ed5a472fcb', '60390c44-abbf-4fdd-83f0-066ce578a310', '26450e48-3e4e-4314-b5ce-83ae2a20dfe7'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:54 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:29:54 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:54 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.272s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:29:54 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Deleted volume successfully. Jul 23 10:29:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b16e892c-9c11-4251-93bf-d0349755a55b tempest-VolumesActionsTest-1153985151 None] Lock "cinder-a02ed443-7de9-465f-aa55-f14032d0a5ed-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Flow 'volume_create_manager' (078f6419-7492-462c-8142-44fe923f0762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6b0c9a-adb6-4700-8003-54d458c37ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6b0c9a-adb6-4700-8003-54d458c37ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1773551581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f844f337-0ee8-47bc-892d-c369e33db970,host='devstack@QuobyteHD#QuobyteHD',id=0d456373-6120-4b84-9c50-4568536a055b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91dbe201d964ea7956bcc8f1c0463f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:55Z,use_quota=True,user_id='7ac106112ef24f148a39103972ef17dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e5ebf0-5045-4c58-af08-dee028210be2),volume_type_id=d8e5ebf0-5045-4c58-af08-dee028210be2)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6472977b-2b2f-464f-a742-4815c0504a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6472977b-2b2f-464f-a742-4815c0504a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1917f41e-25af-4ac4-b1c6-87a18144155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1917f41e-25af-4ac4-b1c6-87a18144155d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d456373-6120-4b84-9c50-4568536a055b', 'volume_name': 'volume-0d456373-6120-4b84-9c50-4568536a055b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831a7b67-109e-4121-b265-db28be1ae2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831a7b67-109e-4121-b265-db28be1ae2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84d961a-a9aa-4f30-93b4-925b020b8986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:55 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Volume 0d456373-6120-4b84-9c50-4568536a055b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d456373-6120-4b84-9c50-4568536a055b', 'volume_size': 1} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f844f337-0ee8-47bc-892d-c369e33db970,created_at=2026-07-23T08:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1773551581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f844f337-0ee8-47bc-892d-c369e33db970,host='devstack@QuobyteHD#QuobyteHD',id=0d456373-6120-4b84-9c50-4568536a055b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91dbe201d964ea7956bcc8f1c0463f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:55Z,use_quota=True,user_id='7ac106112ef24f148a39103972ef17dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e5ebf0-5045-4c58-af08-dee028210be2),volume_type_id=d8e5ebf0-5045-4c58-af08-dee028210be2)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Creating volume 0d456373-6120-4b84-9c50-4568536a055b {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:29:55 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:55 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b 1073741824 Jul 23 10:29:55 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (fd4c4b76-7942-4337-823e-8274853c653c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5205c2a-9b36-4150-a651-30d5a57f3c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5205c2a-9b36-4150-a651-30d5a57f3c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-254913502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab147c9-f22d-4694-a17e-9cb86173cc8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:55Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27180176-177e-445d-8b79-6d7bf41f2fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27180176-177e-445d-8b79-6d7bf41f2fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8529a2c-c451-4a34-b8c2-d22b3adce2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8529a2c-c451-4a34-b8c2-d22b3adce2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab147c9-f22d-4694-a17e-9cb86173cc8e', 'volume_name': 'volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0a4864-ba10-4267-b764-3eb56b23cedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0a4864-ba10-4267-b764-3eb56b23cedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6881d3da-e2a4-4f73-bb80-a0e387c009dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:55 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Volume 7ab147c9-f22d-4694-a17e-9cb86173cc8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e', 'volume_size': 1} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:55 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b 1073741824" returned: 0 in 0.450s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:55 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b Jul 23 10:29:55 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:55 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b" returned: 0 in 0.266s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-254913502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab147c9-f22d-4694-a17e-9cb86173cc8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:55Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Creating volume 7ab147c9-f22d-4694-a17e-9cb86173cc8e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:29:55 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84d961a-a9aa-4f30-93b4-925b020b8986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d456373-6120-4b84-9c50-4568536a055b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:55 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e 1073741824 Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8312f9-a38d-4d19-8777-e44c1b949623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:55 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:55 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Volume volume-0d456373-6120-4b84-9c50-4568536a055b (0d456373-6120-4b84-9c50-4568536a055b): created successfully Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8312f9-a38d-4d19-8777-e44c1b949623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Flow 'volume_create_manager' (078f6419-7492-462c-8142-44fe923f0762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-62d3626c-f716-4fa7-aa6c-032776371b33 tempest-GroupSnapshotsTest-1339401078 None] Created volume successfully. Jul 23 10:29:56 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e 1073741824" returned: 0 in 0.408s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:56 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e Jul 23 10:29:56 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:56 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] GroupSnapshot ef29c188-7f2a-49de-ab72-98abb478f121: creating. Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] Group snapshot ef29c188-7f2a-49de-ab72-98abb478f121: creating. {{(pid=88371) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:56 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e" returned: 0 in 0.260s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.060s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] Creating offline snapshot 68e6c67b-11dd-45ce-bb09-4b1795f8ca16 of volume 0d456373-6120-4b84-9c50-4568536a055b {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6881d3da-e2a4-4f73-bb80-a0e387c009dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f745c88f-4db3-40ad-8c7f-bd6ce88283c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[46478c82-88d9-42fc-a787-0d338ddabb36]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:56 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Volume volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e (7ab147c9-f22d-4694-a17e-9cb86173cc8e): created successfully Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f745c88f-4db3-40ad-8c7f-bd6ce88283c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (fd4c4b76-7942-4337-823e-8274853c653c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:56 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-065af18f-9b36-4d14-9647-e2f2c219327a tempest-VolumesActionsTest-1087494014 None] Created volume successfully. Jul 23 10:29:56 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b Jul 23 10:29:56 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:56 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b" returned: 0 in 0.366s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:56 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 1G Jul 23 10:29:56 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:57 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 1G" returned: 0 in 0.416s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d456373-6120-4b84-9c50-4568536a055b -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:57 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d456373-6120-4b84-9c50-4568536a055b -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 Jul 23 10:29:57 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Acquiring lock "cinder-7ab147c9-f22d-4694-a17e-9cb86173cc8e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Lock "cinder-7ab147c9-f22d-4694-a17e-9cb86173cc8e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:57 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d456373-6120-4b84-9c50-4568536a055b -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16" returned: 0 in 0.311s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:57 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:57 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 Jul 23 10:29:57 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Acquiring lock "cinder-quobyte-7ab147c9-f22d-4694-a17e-9cb86173cc8e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Lock "cinder-quobyte-7ab147c9-f22d-4694-a17e-9cb86173cc8e" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[6501e4ba-a3bc-488d-8966-4ffa15ceaa24]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:57 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e Jul 23 10:29:57 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:57 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16" returned: 0 in 0.248s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:57 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.info Jul 23 10:29:57 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:58 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e" returned: 0 in 0.353s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:58 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e Jul 23 10:29:58 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:58 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.info" returned: 0 in 0.248s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:58 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:58 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.info Jul 23 10:29:58 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:58 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7ab147c9-f22d-4694-a17e-9cb86173cc8e" returned: 0 in 0.248s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Lock "cinder-quobyte-7ab147c9-f22d-4694-a17e-9cb86173cc8e" released by "delete_volume" :: held 0.639s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Created reservations ['77de2bd0-b0f1-41ff-a2e3-312278b0afce', 'b79ef96e-aac7-4c1c-8eda-e532fc55ecfb', 'fca5ef4e-0385-4714-99ae-3425c4326e8c', 'f683a02e-241b-47ae-96b4-99c15c6c05cc'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:29:58 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.info" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:58 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:29:58 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:58 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ee8c3201-efe6-4059-9494-8cb73a87a05c tempest-GroupSnapshotsTest-1339401078 None] group_snapshot ef29c188-7f2a-49de-ab72-98abb478f121: created successfully Jul 23 10:29:58 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.271s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:29:58 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Deleted volume successfully. Jul 23 10:29:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ff64327-6be5-4d1e-a948-aaa6e8561c7c tempest-VolumesActionsTest-1153985151 None] Lock "cinder-7ab147c9-f22d-4694-a17e-9cb86173cc8e-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-68e6c67b-11dd-45ce-bb09-4b1795f8ca16-f9cad122-4fc4-46ca-a001-fc468df4fc19" by "_create_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-68e6c67b-11dd-45ce-bb09-4b1795f8ca16-f9cad122-4fc4-46ca-a001-fc468df4fc19" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Creating volume f9cad122-4fc4-46ca-a001-fc468df4fc19 from snapshot 68e6c67b-11dd-45ce-bb09-4b1795f8ca16 {{(pid=88371) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-f9cad122-4fc4-46ca-a001-fc468df4fc19" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-f9cad122-4fc4-46ca-a001-fc468df4fc19" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] snapshot: 68e6c67b-11dd-45ce-bb09-4b1795f8ca16, volume: f9cad122-4fc4-46ca-a001-fc468df4fc19, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa0883d-6c03-430b-b192-6ea8ee88e156]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (22e80a7f-4bd8-4537-918c-a6a8283887c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58943c48-d32f-4c13-b326-53d7b2c612d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58943c48-d32f-4c13-b326-53d7b2c612d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-642431179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4044f79-5e3c-496a-bf8c-b31c9763646f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:59Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d65d94-d7b7-40f5-86e5-44a66520eb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d65d94-d7b7-40f5-86e5-44a66520eb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd32cc5-a3fc-4aed-bb55-2d1515ea1e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd32cc5-a3fc-4aed-bb55-2d1515ea1e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4044f79-5e3c-496a-bf8c-b31c9763646f', 'volume_name': 'volume-d4044f79-5e3c-496a-bf8c-b31c9763646f', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1922e1f-ff06-4615-a468-1226f2fb05c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1922e1f-ff06-4615-a468-1226f2fb05c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f6d891-b277-47a9-a002-710b0fd419b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:29:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Volume d4044f79-5e3c-496a-bf8c-b31c9763646f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4044f79-5e3c-496a-bf8c-b31c9763646f', 'volume_size': 1} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:29:59 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 Jul 23 10:29:59 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:29:59 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16" returned: 0 in 0.477s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d456373-6120-4b84-9c50-4568536a055b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b222adb-4271-4fdc-a1d2-343c4925eb12]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:29:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:00 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b Jul 23 10:30:00 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:00 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b" returned: 0 in 0.369s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:00 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19 not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:30:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:00 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19 Jul 23 10:30:00 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:05 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19" returned: 0 in 5.073s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:05 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b9ae1d-a5ea-445d-9ab5-ef3a38ffbc95]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:05 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b Jul 23 10:30:05 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:06 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b" returned: 0 in 0.771s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:30:06 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Converted 1024.00 MB image at 201.78 MB/s Jul 23 10:30:06 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:06 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19 Jul 23 10:30:06 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:06 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-957a45b7-426a-4795-a819-cded7f4a3ab7 req-920d8fc6-9000-4ebf-9fcb-c36df37cd22d tempest-TestShelveInstance-924719463 None] Terminate volume connection completed successfully. Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-957a45b7-426a-4795-a819-cded7f4a3ab7 req-920d8fc6-9000-4ebf-9fcb-c36df37cd22d tempest-TestShelveInstance-924719463 None] Deleting attachment da19c7f9-901f-4da6-b62f-61a63f8d08e8. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:30:06 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19" returned: 0 in 0.287s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-f9cad122-4fc4-46ca-a001-fc468df4fc19" released by "_copy_volume_from_snapshot" :: held 7.114s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-68e6c67b-11dd-45ce-bb09-4b1795f8ca16-f9cad122-4fc4-46ca-a001-fc468df4fc19" released by "_create_volume_from_snapshot" :: held 7.150s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.167s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.938s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-642431179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4044f79-5e3c-496a-bf8c-b31c9763646f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:29:59Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Creating volume d4044f79-5e3c-496a-bf8c-b31c9763646f {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:30:06 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:30:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:06 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f 1073741824 Jul 23 10:30:06 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:06 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3a6e92a9-383d-46c0-a03f-e122c582fe41 tempest-GroupSnapshotsTest-1339401078 None] Create group from source-snapshot-ef29c188-7f2a-49de-ab72-98abb478f121 completed successfully. Jul 23 10:30:07 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f 1073741824" returned: 0 in 0.489s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:07 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f Jul 23 10:30:07 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:07 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f" returned: 0 in 0.238s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:30:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f6d891-b277-47a9-a002-710b0fd419b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4044f79-5e3c-496a-bf8c-b31c9763646f', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d362d82-a056-45b9-98e4-12ca1c3425c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:07 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Volume volume-d4044f79-5e3c-496a-bf8c-b31c9763646f (d4044f79-5e3c-496a-bf8c-b31c9763646f): created successfully Jul 23 10:30:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d362d82-a056-45b9-98e4-12ca1c3425c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (22e80a7f-4bd8-4537-918c-a6a8283887c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b4a934a4-691f-4d88-910f-09e5d559efaa tempest-VolumesActionsTest-1087494014 None] Created volume successfully. Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=94,cinder:UPDATE=105,cinder:INSERT=31,cinder:DELETE=8 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-f9cad122-4fc4-46ca-a001-fc468df4fc19" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-f9cad122-4fc4-46ca-a001-fc468df4fc19" acquired by "delete_volume" :: waited 0.040s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d22361-7a86-4f23-8dd9-0f13cbd99bc7]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:08 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19 Jul 23 10:30:08 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Acquiring lock "cinder-d4044f79-5e3c-496a-bf8c-b31c9763646f-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Lock "cinder-d4044f79-5e3c-496a-bf8c-b31c9763646f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Acquiring lock "cinder-quobyte-d4044f79-5e3c-496a-bf8c-b31c9763646f" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Lock "cinder-quobyte-d4044f79-5e3c-496a-bf8c-b31c9763646f" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8a50d6-d962-466c-82cd-eb3a6b79516c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:08 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f Jul 23 10:30:08 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:08 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19" returned: 0 in 0.456s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:08 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19 Jul 23 10:30:08 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:09 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f" returned: 0 in 0.439s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:09 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f9cad122-4fc4-46ca-a001-fc468df4fc19" returned: 0 in 0.290s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:09 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f Jul 23 10:30:09 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-f9cad122-4fc4-46ca-a001-fc468df4fc19" released by "delete_volume" :: held 0.801s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['ef2af471-fea8-43dc-bbb3-6bff4a853529'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:09 devstack cinder-volume[88371]: WARNING cinder.quota [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1901771694 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1901771694, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:30:09 devstack cinder-volume[88371]: WARNING cinder.quota [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1901771694 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1901771694, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['f1def8b1-52b9-4224-9dcd-8a6a82976779', '4857151c-90b6-43c9-9fba-f17a2a1d17b5', 'a6526e72-1012-4914-ac82-ac1d6f11b090', '0d6db950-9297-47ec-97a9-e9c8711d6ccf'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:09 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d4044f79-5e3c-496a-bf8c-b31c9763646f" returned: 0 in 0.306s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Lock "cinder-quobyte-d4044f79-5e3c-496a-bf8c-b31c9763646f" released by "delete_volume" :: held 0.792s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:09 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:30:09 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-31a7c5b2-b0af-46e5-b475-726c742514f7 req-1754d34a-6233-4726-be51-8796c8b6ffe1 tempest-TestShelveInstance-924719463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-31a7c5b2-b0af-46e5-b475-726c742514f7 req-1754d34a-6233-4726-be51-8796c8b6ffe1 tempest-TestShelveInstance-924719463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-31a7c5b2-b0af-46e5-b475-726c742514f7 req-1754d34a-6233-4726-be51-8796c8b6ffe1 tempest-TestShelveInstance-924719463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Created reservations ['bc8837e1-d704-4fec-ae1b-b09473a93bea', '7255fc5b-da01-4fc5-b087-a85529379de7', '1d60debb-be69-4ace-98ec-a8fa8fffcc9b', 'c6c26817-8844-4da4-a061-96dfc7a36a1e'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-31a7c5b2-b0af-46e5-b475-726c742514f7 req-1754d34a-6233-4726-be51-8796c8b6ffe1 tempest-TestShelveInstance-924719463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-974b9502-4946-45d8-b823-c7c47cda58d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1af99159-cb5c-4349-892e-ce1fd1a7dcae', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:30:09 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] group_snapshot ef29c188-7f2a-49de-ab72-98abb478f121: deleting Jul 23 10:30:09 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.306s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:30:09 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c05458c9-5ff2-45c8-a974-454f035321f1 tempest-GroupSnapshotsTest-1339401078 None] Delete group completed successfully. Jul 23 10:30:09 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-31a7c5b2-b0af-46e5-b475-726c742514f7 req-1754d34a-6233-4726-be51-8796c8b6ffe1 tempest-TestShelveInstance-924719463 None] attachment_update completed successfully. Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:09 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:30:09 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] group_snapshot ef29c188-7f2a-49de-ab72-98abb478f121: deleting {{(pid=88371) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-0d456373-6120-4b84-9c50-4568536a055b" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-0d456373-6120-4b84-9c50-4568536a055b" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-68e6c67b-11dd-45ce-bb09-4b1795f8ca16" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-68e6c67b-11dd-45ce-bb09-4b1795f8ca16" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Deleting offline snapshot 68e6c67b-11dd-45ce-bb09-4b1795f8ca16 of volume 0d456373-6120-4b84-9c50-4568536a055b {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:30:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] snapshot_file for this snap is: volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5833307c-a628-4746-8660-2f18d7db8d94]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:10 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 Jul 23 10:30:10 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:10 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.345s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:30:10 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Deleted volume successfully. Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed01cf7e-4958-4c59-9684-b4c3fff48568 tempest-VolumesActionsTest-1153985151 None] Lock "cinder-d4044f79-5e3c-496a-bf8c-b31c9763646f-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:10 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16" returned: 0 in 0.450s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d456373-6120-4b84-9c50-4568536a055b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4443b3-9670-4f51-a435-8bf7807d9c2c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (38fdc5e5-3af0-4f46-83ca-1c49218d933b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570cea5c-464d-4f0f-8c12-1d726d8edc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570cea5c-464d-4f0f-8c12-1d726d8edc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-45408886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040b2d10-728d-48e2-8688-419f75d5256d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:11Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:10 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ae472d-c2a8-46c1-8a92-4a0fe1f0b9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:10 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ae472d-c2a8-46c1-8a92-4a0fe1f0b9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de7a080-1629-489c-b5eb-3248cfee501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de7a080-1629-489c-b5eb-3248cfee501b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040b2d10-728d-48e2-8688-419f75d5256d', 'volume_name': 'volume-040b2d10-728d-48e2-8688-419f75d5256d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356e0e33-dba2-406d-879a-d2747220bfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356e0e33-dba2-406d-879a-d2747220bfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22449b05-fc19-4696-b613-dee830b2c777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:10 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Volume 040b2d10-728d-48e2-8688-419f75d5256d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040b2d10-728d-48e2-8688-419f75d5256d', 'volume_size': 1} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-45408886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040b2d10-728d-48e2-8688-419f75d5256d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba906cff1394da19af2f9eb6669714e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:11Z,use_quota=True,user_id='7d0f9b13d9224e6c91b0c622f14f65a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Creating volume 040b2d10-728d-48e2-8688-419f75d5256d {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:30:10 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:10 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d 1073741824 Jul 23 10:30:10 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:10 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b" returned: 0 in 0.445s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:10 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 Jul 23 10:30:10 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:11 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d 1073741824" returned: 0 in 0.536s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=127,cinder:UPDATE=125,cinder:INSERT=34,cinder:DELETE=10 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:11 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d Jul 23 10:30:11 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:11 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16" returned: 0 in 0.430s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:11 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16 Jul 23 10:30:11 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:11 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d" returned: 0 in 0.296s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22449b05-fc19-4696-b613-dee830b2c777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040b2d10-728d-48e2-8688-419f75d5256d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164f98b2-a7e1-4f86-a196-9c8c90b3b806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:11 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Volume volume-040b2d10-728d-48e2-8688-419f75d5256d (040b2d10-728d-48e2-8688-419f75d5256d): created successfully Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164f98b2-a7e1-4f86-a196-9c8c90b3b806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Flow 'volume_create_manager' (38fdc5e5-3af0-4f46-83ca-1c49218d933b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:11 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0871be2b-f553-4f45-a22b-cfc3caf9d2c6 tempest-VolumesActionsTest-1087494014 None] Created volume successfully. Jul 23 10:30:11 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b.68e6c67b-11dd-45ce-bb09-4b1795f8ca16" returned: 0 in 0.307s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-68e6c67b-11dd-45ce-bb09-4b1795f8ca16" released by "_delete_snapshot" :: held 1.766s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-0d456373-6120-4b84-9c50-4568536a055b" released by "delete_snapshot" :: held 1.813s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:11 devstack cinder-volume[88371]: WARNING cinder.quota [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1901771694 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1901771694, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:30:11 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['f967c6f0-2e80-4596-8900-c343afa64a0d', 'f37b1fce-13f9-4cce-b1a8-069d709a6025', '2bc74110-007e-4045-a4c6-16754b8a1883', '8f56cc95-0589-43ad-ad4d-9e294eff9d4e'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:11 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3e31314a-f26d-4157-9de6-d6519a32c401 tempest-GroupSnapshotsTest-1339401078 None] group_snapshot ef29c188-7f2a-49de-ab72-98abb478f121: deleted successfully Jul 23 10:30:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-0d456373-6120-4b84-9c50-4568536a055b" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-0d456373-6120-4b84-9c50-4568536a055b" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:12 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[6272c60f-ea27-414a-a551-2ce412fbed99]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:12 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b Jul 23 10:30:12 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:13 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b" returned: 0 in 0.765s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:13 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b Jul 23 10:30:13 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:13 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0d456373-6120-4b84-9c50-4568536a055b" returned: 0 in 0.395s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-0d456373-6120-4b84-9c50-4568536a055b" released by "delete_volume" :: held 1.248s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:13 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['bbf6a331-d14e-4153-86a8-0f3b34f8a37d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:13 devstack cinder-volume[88371]: WARNING cinder.db.api [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1901771694'] Jul 23 10:30:13 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['9c4ee587-4a3e-4827-8e81-142f7c3f25db', 'b6b001d9-ba66-4c35-a848-c0d0697ae968', 'df884d5e-282d-4666-97f6-d097118ec013', '7e0edfe5-9c04-4911-bd8b-c2fc60ca1f8b'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Acquiring lock "cinder-040b2d10-728d-48e2-8688-419f75d5256d-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Lock "cinder-040b2d10-728d-48e2-8688-419f75d5256d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Acquiring lock "cinder-quobyte-040b2d10-728d-48e2-8688-419f75d5256d" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:14 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:30:14 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Lock "cinder-quobyte-040b2d10-728d-48e2-8688-419f75d5256d" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c7bb72-6727-4fa0-98de-0e8cb3cf76af]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:14 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d Jul 23 10:30:14 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:14 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.247s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:30:14 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-bbd575f4-f5a2-407c-8117-b0aa12ba323e tempest-GroupSnapshotsTest-1339401078 None] Delete group completed successfully. Jul 23 10:30:14 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d" returned: 0 in 0.390s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:14 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d Jul 23 10:30:14 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:14 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-040b2d10-728d-48e2-8688-419f75d5256d" returned: 0 in 0.276s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Lock "cinder-quobyte-040b2d10-728d-48e2-8688-419f75d5256d" released by "delete_volume" :: held 0.715s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Created reservations ['34da9296-46d9-4515-b976-6eec7afb5c4c', '8cbc4199-3ff1-42ed-a4a2-05a86567a364', '1892345a-db20-43f1-9a99-4f1926882584', 'dc99cd62-9462-417d-b2f2-b138eee7e155'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:15 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:30:15 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:15 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.406s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:15 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:30:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Deleted volume successfully. Jul 23 10:30:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ef620968-c64e-45d4-9fdb-2f13b5bb227a tempest-GroupSnapshotsTest-1339401078 None] Group tempest-GroupSnapshotsTest-Group-332836831: creating Jul 23 10:30:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-248401ff-0fe9-48f5-b9ba-ccc4677e79fd tempest-VolumesActionsTest-1087494014 None] Lock "cinder-040b2d10-728d-48e2-8688-419f75d5256d-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ef620968-c64e-45d4-9fdb-2f13b5bb227a tempest-GroupSnapshotsTest-1339401078 None] Group tempest-GroupSnapshotsTest-Group-332836831: created successfully Jul 23 10:30:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ef620968-c64e-45d4-9fdb-2f13b5bb227a tempest-GroupSnapshotsTest-1339401078 None] Create group completed successfully. Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Flow 'volume_create_manager' (babb861b-8ae9-4dc6-8aed-eb51a7362c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb86d78-b0b2-4eb3-9a1f-0ccccac7e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb86d78-b0b2-4eb3-9a1f-0ccccac7e238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1369004373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8ecbe29-169e-4782-aa47-abbd7bdeb7a2,host='devstack@QuobyteHD#QuobyteHD',id=a8f773c7-7160-4d8a-82a0-59a8074245a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91dbe201d964ea7956bcc8f1c0463f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:17Z,use_quota=True,user_id='7ac106112ef24f148a39103972ef17dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c36f9c-ecb6-4b33-91f6-d27437ced63e),volume_type_id=b0c36f9c-ecb6-4b33-91f6-d27437ced63e)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168eb739-cec0-45a2-910c-e940eb6dec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168eb739-cec0-45a2-910c-e940eb6dec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b116d37d-9b38-4883-bb0c-cc50ba62c469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b116d37d-9b38-4883-bb0c-cc50ba62c469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f773c7-7160-4d8a-82a0-59a8074245a7', 'volume_name': 'volume-a8f773c7-7160-4d8a-82a0-59a8074245a7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd966a8-4245-4f54-b249-33a19d637dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd966a8-4245-4f54-b249-33a19d637dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47a2678-780b-4b7b-b64f-de260923626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:17 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Volume a8f773c7-7160-4d8a-82a0-59a8074245a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f773c7-7160-4d8a-82a0-59a8074245a7', 'volume_size': 1} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8ecbe29-169e-4782-aa47-abbd7bdeb7a2,created_at=2026-07-23T08:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1369004373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8ecbe29-169e-4782-aa47-abbd7bdeb7a2,host='devstack@QuobyteHD#QuobyteHD',id=a8f773c7-7160-4d8a-82a0-59a8074245a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91dbe201d964ea7956bcc8f1c0463f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:17Z,use_quota=True,user_id='7ac106112ef24f148a39103972ef17dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c36f9c-ecb6-4b33-91f6-d27437ced63e),volume_type_id=b0c36f9c-ecb6-4b33-91f6-d27437ced63e)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Creating volume a8f773c7-7160-4d8a-82a0-59a8074245a7 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:30:17 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:17 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 1073741824 Jul 23 10:30:17 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:17 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 1073741824" returned: 0 in 0.507s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:18 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 Jul 23 10:30:18 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:18 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7" returned: 0 in 0.287s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:30:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47a2678-780b-4b7b-b64f-de260923626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f773c7-7160-4d8a-82a0-59a8074245a7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0896bc8f-24e0-4543-8963-2bded23ad8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:18 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Volume volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 (a8f773c7-7160-4d8a-82a0-59a8074245a7): created successfully Jul 23 10:30:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0896bc8f-24e0-4543-8963-2bded23ad8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Flow 'volume_create_manager' (babb861b-8ae9-4dc6-8aed-eb51a7362c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:18 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-20a849ee-65d2-4c9a-9e0e-90c21d8970e8 tempest-GroupSnapshotsTest-1339401078 None] Created volume successfully. Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Flow 'volume_create_manager' (8e2e5c9e-9a10-4731-9b51-8c63a7923201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04075e5e-a545-4009-9fba-7ff477f96327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04075e5e-a545-4009-9fba-7ff477f96327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1663520276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8ecbe29-169e-4782-aa47-abbd7bdeb7a2,host='devstack@QuobyteHD#QuobyteHD',id=f3fb9f08-635a-4b68-82ae-7095daeecee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91dbe201d964ea7956bcc8f1c0463f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:19Z,use_quota=True,user_id='7ac106112ef24f148a39103972ef17dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c36f9c-ecb6-4b33-91f6-d27437ced63e),volume_type_id=b0c36f9c-ecb6-4b33-91f6-d27437ced63e)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3332215-83cd-45e1-a8b8-b8704c0f25c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3332215-83cd-45e1-a8b8-b8704c0f25c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfedb4a8-6ebf-4295-a64f-4f8f08511b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfedb4a8-6ebf-4295-a64f-4f8f08511b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3fb9f08-635a-4b68-82ae-7095daeecee7', 'volume_name': 'volume-f3fb9f08-635a-4b68-82ae-7095daeecee7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7fb42a-14bb-40ce-9c01-872ab806056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7fb42a-14bb-40ce-9c01-872ab806056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d038d7-230c-46f0-b142-fc2165f34623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:19 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Volume f3fb9f08-635a-4b68-82ae-7095daeecee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3fb9f08-635a-4b68-82ae-7095daeecee7', 'volume_size': 1} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8ecbe29-169e-4782-aa47-abbd7bdeb7a2,created_at=2026-07-23T08:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1663520276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8ecbe29-169e-4782-aa47-abbd7bdeb7a2,host='devstack@QuobyteHD#QuobyteHD',id=f3fb9f08-635a-4b68-82ae-7095daeecee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91dbe201d964ea7956bcc8f1c0463f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:19Z,use_quota=True,user_id='7ac106112ef24f148a39103972ef17dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c36f9c-ecb6-4b33-91f6-d27437ced63e),volume_type_id=b0c36f9c-ecb6-4b33-91f6-d27437ced63e)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Creating volume f3fb9f08-635a-4b68-82ae-7095daeecee7 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:30:19 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:30:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:19 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 1073741824 Jul 23 10:30:19 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:20 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 1073741824" returned: 0 in 0.646s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:20 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 Jul 23 10:30:20 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:20 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7" returned: 0 in 0.273s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:30:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d038d7-230c-46f0-b142-fc2165f34623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3fb9f08-635a-4b68-82ae-7095daeecee7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a1e16f-0987-40a3-beec-73895fb88109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:20 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Volume volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 (f3fb9f08-635a-4b68-82ae-7095daeecee7): created successfully Jul 23 10:30:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a1e16f-0987-40a3-beec-73895fb88109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Flow 'volume_create_manager' (8e2e5c9e-9a10-4731-9b51-8c63a7923201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:20 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a397146e-2e92-46cd-b6ac-503966350136 tempest-GroupSnapshotsTest-1339401078 None] Created volume successfully. Jul 23 10:30:22 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ab36a7d9-2467-4c9e-90e6-90d97e33c0c4 tempest-GroupSnapshotsTest-1339401078 None] Update group completed successfully. Jul 23 10:30:23 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ef5da51b-ecb0-49d4-9755-ca7c57fc6929 tempest-GroupSnapshotsTest-1339401078 None] Update group completed successfully. Jul 23 10:30:24 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fe4d61c6-aed4-4209-a4ea-979feef61e63 tempest-GroupSnapshotsTest-1339401078 None] Update group completed successfully. Jul 23 10:30:25 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-539ac6b1-2c63-4f18-8e0d-4700f236cf02 tempest-GroupSnapshotsTest-1339401078 None] Update group completed successfully. Jul 23 10:30:27 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] GroupSnapshot e3b1ba7e-c86e-450d-8a14-5d987a559ab3: creating. Jul 23 10:30:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Group snapshot e3b1ba7e-c86e-450d-8a14-5d987a559ab3: creating. {{(pid=88371) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 10:30:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Creating offline snapshot 06de851d-a0e0-46e7-90a1-622838580056 of volume f3fb9f08-635a-4b68-82ae-7095daeecee7 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:30:27 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d7b03f-919d-4596-beef-30da1055f4d8]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:27 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 Jul 23 10:30:27 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:27 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7" returned: 0 in 0.458s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:27 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 1G Jul 23 10:30:27 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:28 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 1G" returned: 0 in 0.464s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:28 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 Jul 23 10:30:28 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:28 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056" returned: 0 in 0.353s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:28 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:30:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:28 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 Jul 23 10:30:28 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:28 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056" returned: 0 in 0.284s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:29 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.info Jul 23 10:30:29 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:29 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.info" returned: 0 in 0.280s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:29 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:30:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:29 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.info Jul 23 10:30:29 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:29 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.info" returned: 0 in 0.302s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.257s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Creating offline snapshot c550e163-c841-490d-a0f3-a08e2c3ce95f of volume a8f773c7-7160-4d8a-82a0-59a8074245a7 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:30:29 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aade5f-0b71-442b-a5bf-d489375205f5]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:29 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 Jul 23 10:30:29 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:30 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7" returned: 0 in 0.384s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:30 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f 1G Jul 23 10:30:30 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:30 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f 1G" returned: 0 in 0.465s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:30 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f Jul 23 10:30:30 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:30 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f" returned: 0 in 0.340s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:30 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:30:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:30 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f Jul 23 10:30:30 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Flow 'volume_create_manager' (7100528b-69c6-4dc9-9718-16ce34d8e559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:31 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e0e484-58ae-42a2-9acf-ed7e5b0e8224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f" returned: 0 in 0.256s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e0e484-58ae-42a2-9acf-ed7e5b0e8224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-404410247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e55c9b-9170-4139-bfca-2c89d5675f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df1deab779c446b9748a127a4420793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:31Z,use_quota=True,user_id='8df39ec2f35940699d5e6bc7956a2f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666a45e6-6583-452d-85bc-29bce5badb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666a45e6-6583-452d-85bc-29bce5badb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7273111-6697-4d51-a923-d53fda48ffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7273111-6697-4d51-a923-d53fda48ffd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e55c9b-9170-4139-bfca-2c89d5675f5e', 'volume_name': 'volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1614d8d4-600c-40e5-a041-fcdc0c973360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1614d8d4-600c-40e5-a041-fcdc0c973360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe867b5-f267-4fb6-9013-a51e5c5a70e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:31 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Volume f1e55c9b-9170-4139-bfca-2c89d5675f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e', 'volume_size': 1} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:31 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.info Jul 23 10:30:31 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:31 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.info" returned: 0 in 0.248s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:31 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:31 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.info Jul 23 10:30:31 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:31 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.info" returned: 0 in 0.232s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-404410247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e55c9b-9170-4139-bfca-2c89d5675f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df1deab779c446b9748a127a4420793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:31Z,use_quota=True,user_id='8df39ec2f35940699d5e6bc7956a2f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Creating volume f1e55c9b-9170-4139-bfca-2c89d5675f5e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:30:31 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:30:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:31 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e 1073741824 Jul 23 10:30:31 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:31 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3638bfe8-830e-48c0-9cc0-04972496b05b tempest-GroupSnapshotsTest-1339401078 None] group_snapshot e3b1ba7e-c86e-450d-8a14-5d987a559ab3: created successfully Jul 23 10:30:32 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e 1073741824" returned: 0 in 0.412s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:32 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e Jul 23 10:30:32 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:32 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e" returned: 0 in 0.242s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe867b5-f267-4fb6-9013-a51e5c5a70e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad993a3a-655c-46de-9bd8-e972acec707d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:32 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Volume volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e (f1e55c9b-9170-4139-bfca-2c89d5675f5e): created successfully Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad993a3a-655c-46de-9bd8-e972acec707d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Flow 'volume_create_manager' (7100528b-69c6-4dc9-9718-16ce34d8e559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:32 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0552a73c-912d-47e9-81d2-d7d6776f9c65 tempest-VolumesTransfersTest-968825904 None] Created volume successfully. Jul 23 10:30:32 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] group_snapshot e3b1ba7e-c86e-450d-8a14-5d987a559ab3: deleting Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] group_snapshot e3b1ba7e-c86e-450d-8a14-5d987a559ab3: deleting {{(pid=88371) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-f3fb9f08-635a-4b68-82ae-7095daeecee7" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-f3fb9f08-635a-4b68-82ae-7095daeecee7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-06de851d-a0e0-46e7-90a1-622838580056" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-06de851d-a0e0-46e7-90a1-622838580056" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Deleting offline snapshot 06de851d-a0e0-46e7-90a1-622838580056 of volume f3fb9f08-635a-4b68-82ae-7095daeecee7 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] snapshot_file for this snap is: volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fc0d73-671b-49a5-b389-6883ddbf783e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:32 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 Jul 23 10:30:32 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:33 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056" returned: 0 in 0.368s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3fb9f08-635a-4b68-82ae-7095daeecee7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:30:33 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d3bb20-96ba-443b-bb08-e16a3ac5f273]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:33 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 Jul 23 10:30:33 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:33 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7" returned: 0 in 0.358s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:33 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 Jul 23 10:30:33 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:33 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-210649bc-06f8-4590-bc71-1d2d38019ad8 tempest-VolumesTransfersTest-365316863 None] Transfer volume completed successfully. Jul 23 10:30:33 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056" returned: 0 in 0.353s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:33 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056 Jul 23 10:30:33 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Acquiring lock "cinder-f1e55c9b-9170-4139-bfca-2c89d5675f5e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Lock "cinder-f1e55c9b-9170-4139-bfca-2c89d5675f5e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Acquiring lock "cinder-quobyte-f1e55c9b-9170-4139-bfca-2c89d5675f5e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Lock "cinder-quobyte-f1e55c9b-9170-4139-bfca-2c89d5675f5e" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:34 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7.06de851d-a0e0-46e7-90a1-622838580056" returned: 0 in 0.268s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ea92d8-73d0-4936-8bb2-018c67b27048]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-06de851d-a0e0-46e7-90a1-622838580056" released by "_delete_snapshot" :: held 1.460s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-f3fb9f08-635a-4b68-82ae-7095daeecee7" released by "delete_snapshot" :: held 1.481s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-a8f773c7-7160-4d8a-82a0-59a8074245a7" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-a8f773c7-7160-4d8a-82a0-59a8074245a7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-c550e163-c841-490d-a0f3-a08e2c3ce95f" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-c550e163-c841-490d-a0f3-a08e2c3ce95f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Deleting offline snapshot c550e163-c841-490d-a0f3-a08e2c3ce95f of volume a8f773c7-7160-4d8a-82a0-59a8074245a7 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] snapshot_file for this snap is: volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17b1584-e394-490f-afe0-e4504976fe0d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:34 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e Jul 23 10:30:34 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:34 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f Jul 23 10:30:34 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:34 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e" returned: 0 in 0.363s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:34 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e Jul 23 10:30:34 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:34 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f" returned: 0 in 0.364s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8f773c7-7160-4d8a-82a0-59a8074245a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c19d99-2e2d-432c-82af-74fcaba2548b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:34 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 Jul 23 10:30:34 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:34 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f1e55c9b-9170-4139-bfca-2c89d5675f5e" returned: 0 in 0.264s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Lock "cinder-quobyte-f1e55c9b-9170-4139-bfca-2c89d5675f5e" released by "delete_volume" :: held 0.682s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:34 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Created reservations ['31875038-f132-458d-b4df-5ff1f279eda0', '9aa38f73-6c7b-47b3-9c0a-2a95c872c267', '2a17104a-097b-471c-85d8-f952bfc12cc3', 'bc2729d1-c3ad-4a56-9ab6-e1c3a6ba17bd'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:35 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:30:35 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:35 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7" returned: 0 in 0.383s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:35 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f Jul 23 10:30:35 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:35 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.282s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:30:35 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Deleted volume successfully. Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fded2662-570f-4a75-b94f-d4ed32d28e90 tempest-VolumesTransfersTest-669427512 None] Lock "cinder-f1e55c9b-9170-4139-bfca-2c89d5675f5e-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:35 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f" returned: 0 in 0.365s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:35 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f Jul 23 10:30:35 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:35 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7.c550e163-c841-490d-a0f3-a08e2c3ce95f" returned: 0 in 0.248s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-c550e163-c841-490d-a0f3-a08e2c3ce95f" released by "_delete_snapshot" :: held 1.477s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-a8f773c7-7160-4d8a-82a0-59a8074245a7" released by "delete_snapshot" :: held 1.505s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Flow 'volume_create_manager' (c9626c49-db29-4471-b2b3-d942e4371a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1b120f-b420-4344-a45f-3df033afaba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1b120f-b420-4344-a45f-3df033afaba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-674503805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046357f2-f244-4be8-837e-d62c2e004325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df1deab779c446b9748a127a4420793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:36Z,use_quota=True,user_id='8df39ec2f35940699d5e6bc7956a2f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04c310d-01f6-4045-bff8-ccec270e2d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04c310d-01f6-4045-bff8-ccec270e2d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49676dfe-3ce9-40ab-a002-f91f7dbe35f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49676dfe-3ce9-40ab-a002-f91f7dbe35f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046357f2-f244-4be8-837e-d62c2e004325', 'volume_name': 'volume-046357f2-f244-4be8-837e-d62c2e004325', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440271f8-64be-4bc7-9b8d-b07b4064b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440271f8-64be-4bc7-9b8d-b07b4064b70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9b7efc-5469-4f29-a63c-0cdcc6e20d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:35 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Volume 046357f2-f244-4be8-837e-d62c2e004325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046357f2-f244-4be8-837e-d62c2e004325', 'volume_size': 1} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-674503805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046357f2-f244-4be8-837e-d62c2e004325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df1deab779c446b9748a127a4420793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:36Z,use_quota=True,user_id='8df39ec2f35940699d5e6bc7956a2f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Creating volume 046357f2-f244-4be8-837e-d62c2e004325 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:30:35 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:30:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:35 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325 1073741824 Jul 23 10:30:35 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:35 devstack cinder-volume[88371]: WARNING cinder.quota [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1533528316 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1533528316, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:30:35 devstack cinder-volume[88371]: WARNING cinder.quota [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1533528316 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1533528316, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:30:36 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['16d23dbb-da03-40bc-a317-34bf6e9c26d9', 'cf4286c6-09b8-439a-b8d5-aedcb948a860', 'e9b655b8-8d7a-4132-8b96-0c11191ebd4c', '1ea9eb3c-fcf0-45ff-8df9-7e5765dd1ee6'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:36 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['a65279f9-f64e-4d7e-8807-acdb3dfe62f4', '1c19ba7f-7344-4ca3-b4b2-3092fb9d506a', '8b38b3a4-2018-48aa-a935-43725e856ff7', '6dd0eef2-ef04-420a-af93-fd07251eb4f3'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:36 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8698d766-f1d4-4594-b8b2-ddaa6cec09a9 tempest-GroupSnapshotsTest-1339401078 None] group_snapshot e3b1ba7e-c86e-450d-8a14-5d987a559ab3: deleted successfully Jul 23 10:30:36 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325 1073741824" returned: 0 in 0.417s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:36 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325 Jul 23 10:30:36 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:36 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325" returned: 0 in 0.243s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:30:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9b7efc-5469-4f29-a63c-0cdcc6e20d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046357f2-f244-4be8-837e-d62c2e004325', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df028db7-5d70-49cf-9ed8-dcab3deb489f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:36 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Volume volume-046357f2-f244-4be8-837e-d62c2e004325 (046357f2-f244-4be8-837e-d62c2e004325): created successfully Jul 23 10:30:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df028db7-5d70-49cf-9ed8-dcab3deb489f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Flow 'volume_create_manager' (c9626c49-db29-4471-b2b3-d942e4371a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:36 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7ee8af0d-7676-45b7-93e0-3482087bce97 tempest-VolumesTransfersTest-968825904 None] Created volume successfully. Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Acquiring lock "cinder-046357f2-f244-4be8-837e-d62c2e004325-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Lock "cinder-046357f2-f244-4be8-837e-d62c2e004325-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Acquiring lock "cinder-quobyte-046357f2-f244-4be8-837e-d62c2e004325" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Lock "cinder-quobyte-046357f2-f244-4be8-837e-d62c2e004325" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e38f327-d857-411d-977b-a044b7df81fc]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:37 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325 Jul 23 10:30:37 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:37 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325" returned: 0 in 0.371s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:37 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325 Jul 23 10:30:37 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-a8f773c7-7160-4d8a-82a0-59a8074245a7" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-a8f773c7-7160-4d8a-82a0-59a8074245a7" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a7f0be-2a91-4edd-b4c6-9d2eee5c822e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:37 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-046357f2-f244-4be8-837e-d62c2e004325" returned: 0 in 0.255s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:37 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 Jul 23 10:30:37 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Lock "cinder-quobyte-046357f2-f244-4be8-837e-d62c2e004325" released by "delete_volume" :: held 0.667s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Created reservations ['cb39f355-3787-47f1-8cf4-43744e2f1689', '79f4665c-79a6-4932-b656-f5d86e98c5a3', '50c57391-930c-4aa2-9eb7-7c017aacebbc', '282804f6-dd1a-4eba-857b-e11857756ad6'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:37 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:30:37 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:38 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7" returned: 0 in 0.372s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:38 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7 Jul 23 10:30:38 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:38 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.279s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:30:38 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Deleted volume successfully. Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2f8ad2a8-4c66-49ae-99da-2f950029dc44 tempest-VolumesTransfersTest-669427512 None] Lock "cinder-046357f2-f244-4be8-837e-d62c2e004325-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:38 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a8f773c7-7160-4d8a-82a0-59a8074245a7" returned: 0 in 0.299s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-a8f773c7-7160-4d8a-82a0-59a8074245a7" released by "delete_volume" :: held 0.741s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-f3fb9f08-635a-4b68-82ae-7095daeecee7" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-f3fb9f08-635a-4b68-82ae-7095daeecee7" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39661a3-e28f-4b87-860b-9f19256d43c2]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:38 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 Jul 23 10:30:38 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:38 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7" returned: 0 in 0.470s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:38 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7 Jul 23 10:30:38 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:39 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3fb9f08-635a-4b68-82ae-7095daeecee7" returned: 0 in 0.349s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-f3fb9f08-635a-4b68-82ae-7095daeecee7" released by "delete_volume" :: held 0.898s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['e84735ff-e0b1-4909-b923-e818288550d0'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:39 devstack cinder-volume[88371]: WARNING cinder.quota [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1533528316 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1533528316, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['22b676f9-19c6-4900-bc58-d070be731995', '64bc7ecb-dfdc-4509-b3df-4da3d62e2807', '87c84a3e-faaf-4dfd-9efc-b83c2ecfbb8a', '07b540b2-c29a-467a-9357-b4a69ea38280'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['42fce335-83d1-4f26-bf9f-8ceb7821c3f6', '8d1ea9bd-1ab4-450f-95b3-4536272afe04', '809dcec9-5065-48e5-bde1-07a1afbee49f', '195feb63-13c1-4e8c-aaf1-c123a95507ef'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:39 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:30:39 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:39 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.301s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:39 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:30:39 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5593e267-bf27-4816-b669-ff96f14da2b4 tempest-GroupSnapshotsTest-1339401078 None] Delete group completed successfully. Jul 23 10:30:40 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4e806e8e-b70c-434e-961d-e0d20017eadc tempest-GroupSnapshotsTest-1339401078 None] Group tempest-GroupSnapshotsTest-Group-1685264270: creating Jul 23 10:30:40 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4e806e8e-b70c-434e-961d-e0d20017eadc tempest-GroupSnapshotsTest-1339401078 None] Group tempest-GroupSnapshotsTest-Group-1685264270: created successfully Jul 23 10:30:40 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4e806e8e-b70c-434e-961d-e0d20017eadc tempest-GroupSnapshotsTest-1339401078 None] Create group completed successfully. Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Flow 'volume_create_manager' (49ed02f6-48e5-4a8e-89f1-20fa615cda2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ca0c79-5b9c-4167-86e0-cbeb505664d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ca0c79-5b9c-4167-86e0-cbeb505664d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695090928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27da78e2-4df6-4cf9-8e0f-e36f6f804b3c,host='devstack@QuobyteHD#QuobyteHD',id=753e10c4-492d-425d-9f7f-c8369d8e372b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91dbe201d964ea7956bcc8f1c0463f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:42Z,use_quota=True,user_id='7ac106112ef24f148a39103972ef17dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da093fce-a8c9-4f11-b3a3-9358fee2d68b),volume_type_id=da093fce-a8c9-4f11-b3a3-9358fee2d68b)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2231240-5020-4cd1-8a45-d46f4c3eeb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2231240-5020-4cd1-8a45-d46f4c3eeb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8337baa2-6204-41ef-8081-060a080307e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8337baa2-6204-41ef-8081-060a080307e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753e10c4-492d-425d-9f7f-c8369d8e372b', 'volume_name': 'volume-753e10c4-492d-425d-9f7f-c8369d8e372b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8483296d-38e3-4887-af98-fb0c5cbec1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8483296d-38e3-4887-af98-fb0c5cbec1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de23be81-883c-44a9-ac1c-b992302720f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:42 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Volume 753e10c4-492d-425d-9f7f-c8369d8e372b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753e10c4-492d-425d-9f7f-c8369d8e372b', 'volume_size': 1} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=27da78e2-4df6-4cf9-8e0f-e36f6f804b3c,created_at=2026-07-23T08:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695090928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27da78e2-4df6-4cf9-8e0f-e36f6f804b3c,host='devstack@QuobyteHD#QuobyteHD',id=753e10c4-492d-425d-9f7f-c8369d8e372b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91dbe201d964ea7956bcc8f1c0463f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:42Z,use_quota=True,user_id='7ac106112ef24f148a39103972ef17dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da093fce-a8c9-4f11-b3a3-9358fee2d68b),volume_type_id=da093fce-a8c9-4f11-b3a3-9358fee2d68b)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Creating volume 753e10c4-492d-425d-9f7f-c8369d8e372b {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:30:42 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:42 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b 1073741824 Jul 23 10:30:42 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:42 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b 1073741824" returned: 0 in 0.426s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:42 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b Jul 23 10:30:42 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:43 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b" returned: 0 in 0.267s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de23be81-883c-44a9-ac1c-b992302720f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753e10c4-492d-425d-9f7f-c8369d8e372b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f4a022-0445-4d71-8120-b252f40bf5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:43 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Volume volume-753e10c4-492d-425d-9f7f-c8369d8e372b (753e10c4-492d-425d-9f7f-c8369d8e372b): created successfully Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f4a022-0445-4d71-8120-b252f40bf5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Flow 'volume_create_manager' (49ed02f6-48e5-4a8e-89f1-20fa615cda2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:43 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-83906173-fbba-44ac-a205-b8043c3ae425 tempest-GroupSnapshotsTest-1339401078 None] Created volume successfully. Jul 23 10:30:43 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] GroupSnapshot b3022daf-6534-4098-a799-1628c96eb94b: creating. Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] Group snapshot b3022daf-6534-4098-a799-1628c96eb94b: creating. {{(pid=88371) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] Creating offline snapshot 4220fdfe-a8a9-49cf-8479-74e6d8acff01 of volume 753e10c4-492d-425d-9f7f-c8369d8e372b {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daffd79-452d-4f24-ae8c-7ae322de2934]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:43 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b Jul 23 10:30:43 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:44 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b" returned: 0 in 0.395s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:44 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 1G Jul 23 10:30:44 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:44 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 1G" returned: 0 in 0.402s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753e10c4-492d-425d-9f7f-c8369d8e372b -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:44 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753e10c4-492d-425d-9f7f-c8369d8e372b -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 Jul 23 10:30:44 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:44 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753e10c4-492d-425d-9f7f-c8369d8e372b -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01" returned: 0 in 0.314s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:44 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:30:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:44 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 Jul 23 10:30:44 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:45 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01" returned: 0 in 0.256s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:45 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.info Jul 23 10:30:45 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:45 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.info" returned: 0 in 0.244s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:45 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:30:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:45 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.info Jul 23 10:30:45 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:45 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.info" returned: 0 in 0.271s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:45 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ad24bfdf-7e1b-43b2-8b8b-99c7c98d06e6 tempest-GroupSnapshotsTest-1339401078 None] group_snapshot b3022daf-6534-4098-a799-1628c96eb94b: created successfully Jul 23 10:30:45 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] group_snapshot b3022daf-6534-4098-a799-1628c96eb94b: deleting Jul 23 10:30:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] group_snapshot b3022daf-6534-4098-a799-1628c96eb94b: deleting {{(pid=88371) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 10:30:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-753e10c4-492d-425d-9f7f-c8369d8e372b" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-753e10c4-492d-425d-9f7f-c8369d8e372b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-4220fdfe-a8a9-49cf-8479-74e6d8acff01" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-4220fdfe-a8a9-49cf-8479-74e6d8acff01" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Deleting offline snapshot 4220fdfe-a8a9-49cf-8479-74e6d8acff01 of volume 753e10c4-492d-425d-9f7f-c8369d8e372b {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] snapshot_file for this snap is: volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f073a22-eb76-48b3-8ff4-1ebef9458622]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:46 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 Jul 23 10:30:46 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:46 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:30:46 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:46 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01" returned: 0 in 0.376s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-753e10c4-492d-425d-9f7f-c8369d8e372b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9341086c-1f80-40a3-bc4a-7e65b33a4554]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:46 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.323s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:30:46 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b Jul 23 10:30:46 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:46 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b" returned: 0 in 0.418s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:46 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 Jul 23 10:30:46 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:47 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01" returned: 0 in 0.340s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:47 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01 Jul 23 10:30:47 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:47 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b.4220fdfe-a8a9-49cf-8479-74e6d8acff01" returned: 0 in 0.255s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-4220fdfe-a8a9-49cf-8479-74e6d8acff01" released by "_delete_snapshot" :: held 1.519s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-753e10c4-492d-425d-9f7f-c8369d8e372b" released by "delete_snapshot" :: held 1.545s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:47 devstack cinder-volume[88371]: WARNING cinder.quota [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1324271098 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1324271098, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:30:47 devstack cinder-volume[88371]: WARNING cinder.quota [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1324271098 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1324271098, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:30:47 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['7e66e492-9946-470e-95e0-d0d64d27282e', 'a0618f2c-8dda-415f-b642-05857f20db03', '76607420-648b-40d1-8796-d80a362c1951', '0d17ee6e-6a39-422c-8b06-39d349af8275'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:47 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-368c9d4c-757d-40bf-b66f-11b0f915b8d3 tempest-GroupSnapshotsTest-1339401078 None] group_snapshot b3022daf-6534-4098-a799-1628c96eb94b: deleted successfully Jul 23 10:30:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "cinder-quobyte-753e10c4-492d-425d-9f7f-c8369d8e372b" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-753e10c4-492d-425d-9f7f-c8369d8e372b" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:48 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e09b799-763e-4526-af3a-cc41f568cc1b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:48 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b Jul 23 10:30:48 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:49 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b" returned: 0 in 0.426s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:49 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b Jul 23 10:30:49 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:49 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-753e10c4-492d-425d-9f7f-c8369d8e372b" returned: 0 in 0.341s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Lock "cinder-quobyte-753e10c4-492d-425d-9f7f-c8369d8e372b" released by "delete_volume" :: held 0.851s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['52bf7577-6cd7-47d6-9b47-2b41d562a488'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:49 devstack cinder-volume[88371]: WARNING cinder.quota [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1324271098 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1324271098, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Created reservations ['3346cda9-43f6-4007-b1f3-48be3d50e462', 'cb4d98c2-e741-47a4-b4bf-c622fc93f86a', '40d3ef81-ca93-4f75-b276-f4f23af99762', '2ac96542-ed25-45b4-8b04-03f613d5ca5d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:49 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:30:49 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:50 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.294s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:50 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:30:50 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b98d0d28-d2b9-4408-b6c1-34edbf5762ea tempest-GroupSnapshotsTest-1339401078 None] Delete group completed successfully. Jul 23 10:30:52 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Flow 'volume_create_manager' (e2968958-2b77-4931-98b1-25536be611cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b05162-531d-4587-831e-1c3811631ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b05162-531d-4587-831e-1c3811631ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-956102769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97980c88-8e85-4fbb-b726-e6eaf545b666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb11ead1e5d4aa5bd26ba085a00f790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:53Z,use_quota=True,user_id='7a8d33ca1f924120b7df34358b4dc880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f99265-d06c-4bbd-9593-a20fd9a07362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f99265-d06c-4bbd-9593-a20fd9a07362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac966cc-9c03-4252-9856-c3468373be56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac966cc-9c03-4252-9856-c3468373be56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97980c88-8e85-4fbb-b726-e6eaf545b666', 'volume_name': 'volume-97980c88-8e85-4fbb-b726-e6eaf545b666', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aabe8c-a21b-4b75-a809-1deb9219b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aabe8c-a21b-4b75-a809-1deb9219b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da1334e-e458-4d44-b3be-ef046005cfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:53 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Volume 97980c88-8e85-4fbb-b726-e6eaf545b666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97980c88-8e85-4fbb-b726-e6eaf545b666', 'volume_size': 1} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-956102769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97980c88-8e85-4fbb-b726-e6eaf545b666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb11ead1e5d4aa5bd26ba085a00f790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:53Z,use_quota=True,user_id='7a8d33ca1f924120b7df34358b4dc880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Creating volume 97980c88-8e85-4fbb-b726-e6eaf545b666 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:30:53 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:53 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 1073741824 Jul 23 10:30:53 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:53 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 1073741824" returned: 0 in 0.651s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:53 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 Jul 23 10:30:53 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:54 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666" returned: 0 in 0.338s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:30:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da1334e-e458-4d44-b3be-ef046005cfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97980c88-8e85-4fbb-b726-e6eaf545b666', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7719c227-1ddd-4c38-a116-0b878ed16cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:54 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Volume volume-97980c88-8e85-4fbb-b726-e6eaf545b666 (97980c88-8e85-4fbb-b726-e6eaf545b666): created successfully Jul 23 10:30:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7719c227-1ddd-4c38-a116-0b878ed16cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Flow 'volume_create_manager' (e2968958-2b77-4931-98b1-25536be611cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:54 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-101be355-0403-4cf4-9636-9b62ee78ab48 tempest-VolumesActionsTest-1401708746 None] Created volume successfully. Jul 23 10:30:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-887540f7-24b7-422d-b082-d31461710a69 req-adaea616-76a9-415a-b8cc-6f68833a51df tempest-TestShelveInstance-924719463 None] Terminate volume connection completed successfully. Jul 23 10:30:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-887540f7-24b7-422d-b082-d31461710a69 req-adaea616-76a9-415a-b8cc-6f68833a51df tempest-TestShelveInstance-924719463 None] Deleting attachment 1af99159-cb5c-4349-892e-ce1fd1a7dcae. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:30:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Acquiring lock "cinder-974b9502-4946-45d8-b823-c7c47cda58d2-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Lock "cinder-974b9502-4946-45d8-b823-c7c47cda58d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Acquiring lock "cinder-quobyte-974b9502-4946-45d8-b823-c7c47cda58d2" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:30:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Lock "cinder-quobyte-974b9502-4946-45d8-b823-c7c47cda58d2" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:30:56 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09f6d35-21b6-441c-ac35-4adacf286a56]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:30:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:56 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 Jul 23 10:30:56 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:56 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2" returned: 0 in 0.427s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:56 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2 Jul 23 10:30:56 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:56 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-974b9502-4946-45d8-b823-c7c47cda58d2" returned: 0 in 0.317s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Lock "cinder-quobyte-974b9502-4946-45d8-b823-c7c47cda58d2" released by "delete_volume" :: held 0.813s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:56 devstack cinder-volume[88371]: DEBUG cinder.quota [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Created reservations ['f7f9b5fe-d994-4b4d-bf70-cbe0514b6c55', 'e0e161ec-1c9c-471f-8ecd-464084e9fbe5', 'b26928e5-8fcb-4a23-bdae-af1dab33b53b', '38a3d67e-291e-421c-bbe8-f5de649dba73'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:30:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:57 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:30:57 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e9b1c2bd-89af-431c-a9bb-94bb66d2ab58 tempest-GroupSnapshotsV319Test-1792209411 None] Group tempest-GroupSnapshotsV319Test-Group-1169254310: creating Jul 23 10:30:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e9b1c2bd-89af-431c-a9bb-94bb66d2ab58 tempest-GroupSnapshotsV319Test-1792209411 None] Group tempest-GroupSnapshotsV319Test-Group-1169254310: created successfully Jul 23 10:30:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e9b1c2bd-89af-431c-a9bb-94bb66d2ab58 tempest-GroupSnapshotsV319Test-1792209411 None] Create group completed successfully. Jul 23 10:30:57 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.413s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:57 devstack cinder-volume[88371]: DEBUG cinder.manager [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:30:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Deleted volume successfully. Jul 23 10:30:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [req-887540f7-24b7-422d-b082-d31461710a69 req-ad7aa597-af7e-4e48-a28e-31d87265bc29 tempest-TestShelveInstance-924719463 None] Lock "cinder-974b9502-4946-45d8-b823-c7c47cda58d2-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:30:58 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:30:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Flow 'volume_create_manager' (128c6cdb-4f8d-4bf9-94cd-7d4c420a606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ea337c-2c4e-41e5-8aa9-b72cb8687001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ea337c-2c4e-41e5-8aa9-b72cb8687001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-389764295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=249131e6-e2e4-4e64-8f0a-3c829d6aa443,host='devstack@QuobyteHD#QuobyteHD',id=882f067f-0555-4ce2-ad94-5cc0ae5747d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2e896cd5614d63a2983698ccb08230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:59Z,use_quota=True,user_id='ef637936e8f14dca966ccba274b68a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(360401b2-4e6e-4d6d-976d-946871df5af1),volume_type_id=360401b2-4e6e-4d6d-976d-946871df5af1)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29139063-967f-4bb5-8231-d86227773fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29139063-967f-4bb5-8231-d86227773fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124746aa-2d78-4074-b70a-24ffa3a811e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124746aa-2d78-4074-b70a-24ffa3a811e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882f067f-0555-4ce2-ad94-5cc0ae5747d8', 'volume_name': 'volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fa4324-ac0d-45b0-8c4d-711f0c7a499d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fa4324-ac0d-45b0-8c4d-711f0c7a499d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7107785d-15b3-4062-afc7-baa7213fbf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:30:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Volume 882f067f-0555-4ce2-ad94-5cc0ae5747d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8', 'volume_size': 1} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=249131e6-e2e4-4e64-8f0a-3c829d6aa443,created_at=2026-07-23T08:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-389764295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=249131e6-e2e4-4e64-8f0a-3c829d6aa443,host='devstack@QuobyteHD#QuobyteHD',id=882f067f-0555-4ce2-ad94-5cc0ae5747d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2e896cd5614d63a2983698ccb08230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:30:59Z,use_quota=True,user_id='ef637936e8f14dca966ccba274b68a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(360401b2-4e6e-4d6d-976d-946871df5af1),volume_type_id=360401b2-4e6e-4d6d-976d-946871df5af1)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Creating volume 882f067f-0555-4ce2-ad94-5cc0ae5747d8 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:30:59 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:59 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 1073741824 Jul 23 10:30:59 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:30:59 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 1073741824" returned: 0 in 0.531s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:30:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:30:59 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 Jul 23 10:30:59 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:00 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8" returned: 0 in 0.457s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:31:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7107785d-15b3-4062-afc7-baa7213fbf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144d94b0-fa9e-4273-86e9-9215af387d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:00 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Volume volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 (882f067f-0555-4ce2-ad94-5cc0ae5747d8): created successfully Jul 23 10:31:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144d94b0-fa9e-4273-86e9-9215af387d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Flow 'volume_create_manager' (128c6cdb-4f8d-4bf9-94cd-7d4c420a606b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fd0ac0a1-d3e6-4b8c-97c8-ae26b108b49f tempest-GroupSnapshotsV319Test-1792209411 None] Created volume successfully. Jul 23 10:31:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] GroupSnapshot 22ba77ae-a5bf-40c0-bf41-9025fdd6291f: creating. Jul 23 10:31:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] Group snapshot 22ba77ae-a5bf-40c0-bf41-9025fdd6291f: creating. {{(pid=88371) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 10:31:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] Creating offline snapshot 3c6b73b2-b16d-4c88-862e-dee97824bd24 of volume 882f067f-0555-4ce2-ad94-5cc0ae5747d8 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:31:01 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02ab7b5-b587-4aca-9d24-e8fac2f378fb]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:01 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 Jul 23 10:31:01 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:02 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8" returned: 0 in 0.484s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:02 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 1G Jul 23 10:31:02 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:02 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 1G" returned: 0 in 0.827s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:03 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 Jul 23 10:31:03 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:03 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24" returned: 0 in 0.481s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:03 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:31:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:03 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 Jul 23 10:31:03 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:03 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24" returned: 0 in 0.350s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:03 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.info Jul 23 10:31:03 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:04 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.info" returned: 0 in 0.310s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:04 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:31:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:04 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.info Jul 23 10:31:04 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:04 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.info" returned: 0 in 0.255s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.817s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8ac5faa6-87c8-4a62-9582-5944f91488c3 tempest-GroupSnapshotsV319Test-1792209411 None] group_snapshot 22ba77ae-a5bf-40c0-bf41-9025fdd6291f: created successfully Jul 23 10:31:05 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] group_snapshot 22ba77ae-a5bf-40c0-bf41-9025fdd6291f: deleting Jul 23 10:31:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] group_snapshot 22ba77ae-a5bf-40c0-bf41-9025fdd6291f: deleting {{(pid=88371) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 10:31:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Acquiring lock "cinder-quobyte-882f067f-0555-4ce2-ad94-5cc0ae5747d8" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Lock "cinder-quobyte-882f067f-0555-4ce2-ad94-5cc0ae5747d8" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Acquiring lock "cinder-quobyte-3c6b73b2-b16d-4c88-862e-dee97824bd24" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Lock "cinder-quobyte-3c6b73b2-b16d-4c88-862e-dee97824bd24" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Deleting offline snapshot 3c6b73b2-b16d-4c88-862e-dee97824bd24 of volume 882f067f-0555-4ce2-ad94-5cc0ae5747d8 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:31:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] snapshot_file for this snap is: volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:31:05 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[299862cb-6905-427b-a647-2d2b25140234]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:05 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 Jul 23 10:31:05 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:06 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24" returned: 0 in 0.470s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:31:06 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd362eb-12e0-4e6c-a91c-c6e50ca3f5f6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:06 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 Jul 23 10:31:06 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-835a2a94-ca2b-49ba-80ca-0ec63758cca4 tempest-VolumesActionsTest-1401708746 None] Acquiring lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666" by "attach_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:06 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-835a2a94-ca2b-49ba-80ca-0ec63758cca4 tempest-VolumesActionsTest-1401708746 None] Lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666" acquired by "attach_volume" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8" returned: 0 in 0.609s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:06 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 Jul 23 10:31:06 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-835a2a94-ca2b-49ba-80ca-0ec63758cca4 tempest-VolumesActionsTest-1401708746 None] Attaching volume 97980c88-8e85-4fbb-b726-e6eaf545b666 to instance b013fdd7-5de8-46cf-b7db-9cecaadec413 at mountpoint /dev/vdb on host None. Jul 23 10:31:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-835a2a94-ca2b-49ba-80ca-0ec63758cca4 tempest-VolumesActionsTest-1401708746 None] Attach volume completed successfully. Jul 23 10:31:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-835a2a94-ca2b-49ba-80ca-0ec63758cca4 tempest-VolumesActionsTest-1401708746 None] Lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666" released by "attach_volume" :: held 0.183s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-35dd9f7c-7a6e-48a4-a95d-b2ed22521a87 tempest-VolumesActionsTest-1401708746 None] Acquiring lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666-detach_volume" by "detach_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-35dd9f7c-7a6e-48a4-a95d-b2ed22521a87 tempest-VolumesActionsTest-1401708746 None] Lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-35dd9f7c-7a6e-48a4-a95d-b2ed22521a87 tempest-VolumesActionsTest-1401708746 None] Detaching volume 97980c88-8e85-4fbb-b726-e6eaf545b666 from instance b013fdd7-5de8-46cf-b7db-9cecaadec413. Jul 23 10:31:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-35dd9f7c-7a6e-48a4-a95d-b2ed22521a87 tempest-VolumesActionsTest-1401708746 None] Detach volume completed successfully. Jul 23 10:31:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-35dd9f7c-7a6e-48a4-a95d-b2ed22521a87 tempest-VolumesActionsTest-1401708746 None] Lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:07 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24" returned: 0 in 0.623s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:07 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24 Jul 23 10:31:07 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:07 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8.3c6b73b2-b16d-4c88-862e-dee97824bd24" returned: 0 in 0.365s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Lock "cinder-quobyte-3c6b73b2-b16d-4c88-862e-dee97824bd24" released by "_delete_snapshot" :: held 2.252s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Lock "cinder-quobyte-882f067f-0555-4ce2-ad94-5cc0ae5747d8" released by "delete_snapshot" :: held 2.335s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:08 devstack cinder-volume[88371]: WARNING cinder.quota [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-379889367 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-379889367, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:31:08 devstack cinder-volume[88371]: WARNING cinder.quota [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-379889367 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-379889367, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:31:08 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] Created reservations ['7c9961ac-52e1-429f-ad6f-53dc7054a275', '3b25a518-549c-48b4-932e-8a0e339a8297', '8fabe693-a873-47dd-9f45-42c6e72b599e', '3381101c-404c-4bd9-9463-133c3f591199'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:31:08 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4ad99cc6-3e51-4fbe-b9c9-6ce46ab0aae5 tempest-GroupSnapshotsV319Test-1792209411 None] group_snapshot 22ba77ae-a5bf-40c0-bf41-9025fdd6291f: deleted successfully Jul 23 10:31:09 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=162,cinder:UPDATE=169,cinder:INSERT=41,cinder:DELETE=4 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:31:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Acquiring lock "cinder-quobyte-882f067f-0555-4ce2-ad94-5cc0ae5747d8" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Lock "cinder-quobyte-882f067f-0555-4ce2-ad94-5cc0ae5747d8" acquired by "delete_volume" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:09 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d01248-19c8-4178-b9ab-c1022409adfb]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:09 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 Jul 23 10:31:09 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:09 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8" returned: 0 in 0.418s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:09 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8 Jul 23 10:31:09 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:10 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-882f067f-0555-4ce2-ad94-5cc0ae5747d8" returned: 0 in 0.291s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Lock "cinder-quobyte-882f067f-0555-4ce2-ad94-5cc0ae5747d8" released by "delete_volume" :: held 0.797s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Created reservations ['37bc06c9-f6e2-4a2f-b614-6637c671d1ff'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:31:10 devstack cinder-volume[88371]: WARNING cinder.quota [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-379889367 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-379889367, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Created reservations ['f5901e72-5d52-4c2f-bde9-b061f39acf11', '526debd0-bb68-4509-ab2e-21dd41d9ddbe', 'e20f68ab-ff03-4694-8dc3-d16ba6cd4617', 'b79c9c5a-ae70-48a5-b416-1c709de63fcf'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:10 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:31:10 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:10 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.302s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:10 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:31:10 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9c5116b6-4947-4941-a6bf-54af4e4d271b tempest-GroupSnapshotsV319Test-1792209411 None] Delete group completed successfully. Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=153,cinder:DELETE=8,cinder:SELECT=141,cinder:INSERT=35 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Flow 'volume_create_manager' (14fa72f7-137a-4053-bd36-649f98a69d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90858fe4-d08f-48d6-8151-7218a95853a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90858fe4-d08f-48d6-8151-7218a95853a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944cc8ad-4a87-4c16-af35-abd34e9b900a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badaf024a1f454a9279a02b9b44c3a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:11Z,use_quota=True,user_id='fc16b97e7ce1439cae5b9f019d0e94fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345016fc-dd74-4c95-a2b5-a32f0a795951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345016fc-dd74-4c95-a2b5-a32f0a795951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ea12db-aa5a-4200-ac32-edff147ec09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ea12db-aa5a-4200-ac32-edff147ec09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944cc8ad-4a87-4c16-af35-abd34e9b900a', 'volume_name': 'volume-944cc8ad-4a87-4c16-af35-abd34e9b900a', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2ece74-0d4b-45d8-8d1a-ab12dff19e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2ece74-0d4b-45d8-8d1a-ab12dff19e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ceb74d-5235-4d0f-8758-f82379b4f3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:11 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Volume 944cc8ad-4a87-4c16-af35-abd34e9b900a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944cc8ad-4a87-4c16-af35-abd34e9b900a', 'volume_size': 1} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944cc8ad-4a87-4c16-af35-abd34e9b900a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badaf024a1f454a9279a02b9b44c3a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:11Z,use_quota=True,user_id='fc16b97e7ce1439cae5b9f019d0e94fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Creating volume 944cc8ad-4a87-4c16-af35-abd34e9b900a {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:31:11 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:31:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:11 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a 1073741824 Jul 23 10:31:11 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:12 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a 1073741824" returned: 0 in 0.583s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:12 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a Jul 23 10:31:12 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:12 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a" returned: 0 in 0.336s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:31:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ceb74d-5235-4d0f-8758-f82379b4f3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944cc8ad-4a87-4c16-af35-abd34e9b900a', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb53369-56f7-4088-aef0-6976d45222c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:12 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Volume volume-944cc8ad-4a87-4c16-af35-abd34e9b900a (944cc8ad-4a87-4c16-af35-abd34e9b900a): created successfully Jul 23 10:31:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb53369-56f7-4088-aef0-6976d45222c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Flow 'volume_create_manager' (14fa72f7-137a-4053-bd36-649f98a69d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:12 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-371c44b8-ef3a-4495-a4da-f43f800c55d0 tempest-CinderUnicodeTest-1145698037 None] Created volume successfully. Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Flow 'volume_create_manager' (2c55e677-29fd-44dc-8820-c18be7a61f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9048b9-d424-413c-a101-64e7f07dccac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9048b9-d424-413c-a101-64e7f07dccac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:31:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-150708058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68f5e28-fdbf-4d66-8c84-5d1841053d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badaf024a1f454a9279a02b9b44c3a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:14Z,use_quota=True,user_id='fc16b97e7ce1439cae5b9f019d0e94fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4af80a4-94ef-470d-b064-55ad505dc5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4af80a4-94ef-470d-b064-55ad505dc5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aba61de-7d35-40d5-8b37-d7b7e240c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aba61de-7d35-40d5-8b37-d7b7e240c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68f5e28-fdbf-4d66-8c84-5d1841053d6d', 'volume_name': 'volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78a5021-0a56-43f9-9589-bcbfb587a116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78a5021-0a56-43f9-9589-bcbfb587a116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e55972a-08b6-4660-b8a4-4615b27e00d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:14 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Volume f68f5e28-fdbf-4d66-8c84-5d1841053d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d', 'volume_size': 1} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:31:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-150708058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68f5e28-fdbf-4d66-8c84-5d1841053d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1badaf024a1f454a9279a02b9b44c3a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:14Z,use_quota=True,user_id='fc16b97e7ce1439cae5b9f019d0e94fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Creating volume f68f5e28-fdbf-4d66-8c84-5d1841053d6d {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:31:14 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:31:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:14 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d 1073741824 Jul 23 10:31:14 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:15 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d 1073741824" returned: 0 in 0.527s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:15 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d Jul 23 10:31:15 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:15 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d" returned: 0 in 0.341s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:31:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e55972a-08b6-4660-b8a4-4615b27e00d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9cef20-1ac4-458a-ba2e-3914b81fd6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:15 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Volume volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d (f68f5e28-fdbf-4d66-8c84-5d1841053d6d): created successfully Jul 23 10:31:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9cef20-1ac4-458a-ba2e-3914b81fd6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Flow 'volume_create_manager' (2c55e677-29fd-44dc-8820-c18be7a61f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b621156b-5ad0-44f1-85b6-103518c37340 tempest-CinderUnicodeTest-1145698037 None] Created volume successfully. Jul 23 10:31:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] Creating offline snapshot b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 of volume f68f5e28-fdbf-4d66-8c84-5d1841053d6d {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:31:17 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e3dcf1-541f-48f7-993b-e9991fa923de]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a57f402e-bf6f-42cd-867d-b40f06bf23a6 tempest-GroupsTest-1191682608 None] Group tempest-Group1-1369483573: creating Jul 23 10:31:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a57f402e-bf6f-42cd-867d-b40f06bf23a6 tempest-GroupsTest-1191682608 None] Group tempest-Group1-1369483573: created successfully Jul 23 10:31:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a57f402e-bf6f-42cd-867d-b40f06bf23a6 tempest-GroupsTest-1191682608 None] Create group completed successfully. Jul 23 10:31:17 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d Jul 23 10:31:17 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:17 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d" returned: 0 in 0.419s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:17 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 1G Jul 23 10:31:17 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:17 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 1G" returned: 0 in 0.412s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:17 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 Jul 23 10:31:17 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:18 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2" returned: 0 in 0.439s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:18 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 is being set with open permissions: ugo+rw Jul 23 10:31:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:18 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 Jul 23 10:31:18 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:18 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2" returned: 0 in 0.312s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:18 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-420aeb6f-7d48-4313-8931-94ee2bd2d83a tempest-GroupsTest-1191682608 None] Group tempest-Group2-916202587: creating Jul 23 10:31:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:18 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-420aeb6f-7d48-4313-8931-94ee2bd2d83a tempest-GroupsTest-1191682608 None] Group tempest-Group2-916202587: created successfully Jul 23 10:31:18 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-420aeb6f-7d48-4313-8931-94ee2bd2d83a tempest-GroupsTest-1191682608 None] Create group completed successfully. Jul 23 10:31:18 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.info Jul 23 10:31:18 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:18 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.info" returned: 0 in 0.268s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:18 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.info is being set with open permissions: ugo+rw Jul 23 10:31:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:18 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.info Jul 23 10:31:18 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:19 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.info" returned: 0 in 0.254s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0490deb0-76d1-4ffb-b525-a22b4c4e0eee tempest-CinderUnicodeTest-1145698037 None] Create snapshot completed successfully Jul 23 10:31:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8242e864-f9fa-4722-8e42-f77494941c0b tempest-VolumesActionsTest-1401708746 None] Acquiring lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666" by "attach_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8242e864-f9fa-4722-8e42-f77494941c0b tempest-VolumesActionsTest-1401708746 None] Lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666" acquired by "attach_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8242e864-f9fa-4722-8e42-f77494941c0b tempest-VolumesActionsTest-1401708746 None] Attaching volume 97980c88-8e85-4fbb-b726-e6eaf545b666 to instance 6b6f3dd0-07f4-49ce-b8c4-b23130f3c302 at mountpoint /dev/vdb on host None. Jul 23 10:31:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8242e864-f9fa-4722-8e42-f77494941c0b tempest-VolumesActionsTest-1401708746 None] Attach volume completed successfully. Jul 23 10:31:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8242e864-f9fa-4722-8e42-f77494941c0b tempest-VolumesActionsTest-1401708746 None] Lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666" released by "attach_volume" :: held 0.093s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d7b3851a-84cf-46d4-8040-e4c2ab0b3aa7 tempest-VolumesActionsTest-1401708746 None] Acquiring lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666-detach_volume" by "detach_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d7b3851a-84cf-46d4-8040-e4c2ab0b3aa7 tempest-VolumesActionsTest-1401708746 None] Lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d7b3851a-84cf-46d4-8040-e4c2ab0b3aa7 tempest-VolumesActionsTest-1401708746 None] Detaching volume 97980c88-8e85-4fbb-b726-e6eaf545b666 from instance 6b6f3dd0-07f4-49ce-b8c4-b23130f3c302. Jul 23 10:31:20 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d7b3851a-84cf-46d4-8040-e4c2ab0b3aa7 tempest-VolumesActionsTest-1401708746 None] Detach volume completed successfully. Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d7b3851a-84cf-46d4-8040-e4c2ab0b3aa7 tempest-VolumesActionsTest-1401708746 None] Lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666-detach_volume" released by "detach_volume" :: held 0.072s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "cinder-b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "cinder-quobyte-f68f5e28-fdbf-4d66-8c84-5d1841053d6d" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-quobyte-f68f5e28-fdbf-4d66-8c84-5d1841053d6d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "cinder-quobyte-b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-quobyte-b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Deleting offline snapshot b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 of volume f68f5e28-fdbf-4d66-8c84-5d1841053d6d {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] snapshot_file for this snap is: volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[363bfad3-a686-411b-9ac9-8800b3d4cddb]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:31:20 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 Jul 23 10:31:20 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Flow 'volume_create_manager' (1e11a6a4-b2ca-41ed-a3ab-3b0b603f2e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f4a290-fd17-43c8-a201-3a90fe92bc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f4a290-fd17-43c8-a201-3a90fe92bc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1333654194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=816b8a8f-4c2c-4d7c-9e5f-c702d197ee1c,host='devstack@QuobyteHD#QuobyteHD',id=d9740a92-0a92-4408-b03f-bad630d7aff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ab2e6c098f446fa38d89b21467f871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:21Z,use_quota=True,user_id='cfe8ced7118a4502bea0b2782d03f8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90f289d3-107b-47fb-907a-6d50c5c63cf6),volume_type_id=90f289d3-107b-47fb-907a-6d50c5c63cf6)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b053f2fb-d545-4bfa-ab5f-d0b8ce53ea7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b053f2fb-d545-4bfa-ab5f-d0b8ce53ea7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac25a957-b86c-4a17-8af8-47b8707c1d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac25a957-b86c-4a17-8af8-47b8707c1d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9740a92-0a92-4408-b03f-bad630d7aff6', 'volume_name': 'volume-d9740a92-0a92-4408-b03f-bad630d7aff6', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb96ffda-eac0-4bcd-bd94-8a0ab99c200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb96ffda-eac0-4bcd-bd94-8a0ab99c200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da602cc0-2d18-49ec-b874-21fad28258ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:20 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Volume d9740a92-0a92-4408-b03f-bad630d7aff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9740a92-0a92-4408-b03f-bad630d7aff6', 'volume_size': 1} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=816b8a8f-4c2c-4d7c-9e5f-c702d197ee1c,created_at=2026-07-23T08:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1333654194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=816b8a8f-4c2c-4d7c-9e5f-c702d197ee1c,host='devstack@QuobyteHD#QuobyteHD',id=d9740a92-0a92-4408-b03f-bad630d7aff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ab2e6c098f446fa38d89b21467f871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:21Z,use_quota=True,user_id='cfe8ced7118a4502bea0b2782d03f8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90f289d3-107b-47fb-907a-6d50c5c63cf6),volume_type_id=90f289d3-107b-47fb-907a-6d50c5c63cf6)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Creating volume d9740a92-0a92-4408-b03f-bad630d7aff6 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:31:20 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:31:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:20 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6 1073741824 Jul 23 10:31:20 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:21 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2" returned: 0 in 0.544s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[24703a74-bc96-4255-af48-019897d200cf]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:21 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d Jul 23 10:31:21 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:21 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6 1073741824" returned: 0 in 0.613s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:21 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6 Jul 23 10:31:21 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:21 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d" returned: 0 in 0.443s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:21 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 Jul 23 10:31:21 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:21 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6" returned: 0 in 0.381s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da602cc0-2d18-49ec-b874-21fad28258ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9740a92-0a92-4408-b03f-bad630d7aff6', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e6e3ba-9ca1-447a-8b00-8968b0d9693f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:21 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Volume volume-d9740a92-0a92-4408-b03f-bad630d7aff6 (d9740a92-0a92-4408-b03f-bad630d7aff6): created successfully Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e6e3ba-9ca1-447a-8b00-8968b0d9693f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Flow 'volume_create_manager' (1e11a6a4-b2ca-41ed-a3ab-3b0b603f2e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:21 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-54e150c9-4449-49b3-a2cf-66f13c9e11d7 tempest-GroupsTest-1191682608 None] Created volume successfully. Jul 23 10:31:22 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2" returned: 0 in 0.483s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:22 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2 Jul 23 10:31:22 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:22 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d.b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2" returned: 0 in 0.330s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-quobyte-b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2" released by "_delete_snapshot" :: held 1.962s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-quobyte-f68f5e28-fdbf-4d66-8c84-5d1841053d6d" released by "delete_snapshot" :: held 2.005s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:22 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Created reservations ['f3463d43-0d62-4f7f-923a-79349fde9598', '1da68093-8d69-40eb-8c51-c2a9dc646698', 'f1b9c87c-a10b-47e3-b81e-28f54105cec5', 'a6ee2532-e482-4119-adfa-fd52a739c4fa'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:31:22 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Delete snapshot completed successfully. Jul 23 10:31:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-af0ddaed-fc98-49eb-9665-505cf74ce99d tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-b4f6a2d2-68df-4e0e-84c6-9ec9bc0037c2-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Acquiring lock "cinder-quobyte-d9740a92-0a92-4408-b03f-bad630d7aff6" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Lock "cinder-quobyte-d9740a92-0a92-4408-b03f-bad630d7aff6" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "cinder-f68f5e28-fdbf-4d66-8c84-5d1841053d6d-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:23 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5394e3a-a7c5-4831-a6a0-531f96a464c1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-f68f5e28-fdbf-4d66-8c84-5d1841053d6d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "cinder-quobyte-f68f5e28-fdbf-4d66-8c84-5d1841053d6d" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-quobyte-f68f5e28-fdbf-4d66-8c84-5d1841053d6d" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:23 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6 Jul 23 10:31:23 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:23 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dae452-7dc2-4cce-adf0-380df2bd82bb]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:23 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d Jul 23 10:31:23 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:24 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6" returned: 0 in 0.430s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:24 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6 Jul 23 10:31:24 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:24 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d" returned: 0 in 0.416s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:24 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d Jul 23 10:31:24 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:24 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9740a92-0a92-4408-b03f-bad630d7aff6" returned: 0 in 0.262s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Lock "cinder-quobyte-d9740a92-0a92-4408-b03f-bad630d7aff6" released by "delete_volume" :: held 0.757s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Created reservations ['5a3d2630-0c46-4ee6-a2e1-e0750b2bc753'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:31:24 devstack cinder-volume[88371]: WARNING cinder.quota [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-681797027 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-681797027, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:31:24 devstack cinder-volume[88371]: WARNING cinder.quota [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-681797027 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-681797027, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Created reservations ['089bb061-791b-47ae-a775-25f337e1bcc1', 'e08d4fdf-a444-4b73-abdb-cd468f41c311', 'c54cf557-1132-49b8-840a-a6dddca65edc', '994df99c-30af-4f4d-b7ca-e3227359a671'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:31:24 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f68f5e28-fdbf-4d66-8c84-5d1841053d6d" returned: 0 in 0.270s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-quobyte-f68f5e28-fdbf-4d66-8c84-5d1841053d6d" released by "delete_volume" :: held 0.772s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Created reservations ['c5e459e2-8e5e-416e-8535-b7dcd9e2f18f', 'caf5891c-384d-46d7-b749-bbedc6f12589', 'b23a9755-986d-4eee-b1f9-1c6440c92905', '834570b6-f7ab-463c-ad96-6f5431380491'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:24 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:31:24 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:24 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:31:24 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:24 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "cinder-944cc8ad-4a87-4c16-af35-abd34e9b900a-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.298s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:31:24 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-81d3b0d6-7bb0-4025-be5c-fd35ef42aa0c tempest-GroupsTest-1191682608 None] Delete group completed successfully. Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-944cc8ad-4a87-4c16-af35-abd34e9b900a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "cinder-quobyte-944cc8ad-4a87-4c16-af35-abd34e9b900a" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-quobyte-944cc8ad-4a87-4c16-af35-abd34e9b900a" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[7debb202-71d0-46ab-bf23-b3b2170c267b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:25 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.342s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:31:25 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Deleted volume successfully. Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ab7793f9-e999-4b2c-a7c3-3d3b81971b80 tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-f68f5e28-fdbf-4d66-8c84-5d1841053d6d-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-11bb783f-31fb-4abf-b9c5-ffc2abd628eb tempest-GroupsTest-1191682608 None] Created reservations ['0677a5d1-a843-4fe1-8bfb-de2606d02f6c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:31:25 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a Jul 23 10:31:25 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-11bb783f-31fb-4abf-b9c5-ffc2abd628eb tempest-GroupsTest-1191682608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-11bb783f-31fb-4abf-b9c5-ffc2abd628eb tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-11bb783f-31fb-4abf-b9c5-ffc2abd628eb tempest-GroupsTest-1191682608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-11bb783f-31fb-4abf-b9c5-ffc2abd628eb tempest-GroupsTest-1191682608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-11bb783f-31fb-4abf-b9c5-ffc2abd628eb tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-11bb783f-31fb-4abf-b9c5-ffc2abd628eb tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:25 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:31:25 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a98b50-c267-46c0-96e5-519da6b4f158]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:25 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 Jul 23 10:31:25 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:25 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a" returned: 0 in 0.407s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:25 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a Jul 23 10:31:25 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:25 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-11bb783f-31fb-4abf-b9c5-ffc2abd628eb tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.254s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-11bb783f-31fb-4abf-b9c5-ffc2abd628eb tempest-GroupsTest-1191682608 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:31:25 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-11bb783f-31fb-4abf-b9c5-ffc2abd628eb tempest-GroupsTest-1191682608 None] Delete group completed successfully. Jul 23 10:31:25 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666" returned: 0 in 0.396s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[474cf2ae-6a28-4f2b-8e43-8a4807f7e926]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:25 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-944cc8ad-4a87-4c16-af35-abd34e9b900a" returned: 0 in 0.265s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-quobyte-944cc8ad-4a87-4c16-af35-abd34e9b900a" released by "delete_volume" :: held 0.729s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Created reservations ['74652d5f-4da0-49a7-a8d3-0530a5a75fa2', 'ea1eb283-e823-4a12-acd5-ee6d38a211c3', 'dc4e69e7-35fa-4450-8fd6-96fb5917521a', 'ca71c734-b63c-483a-9c97-737d51ce5cdd'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:31:25 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 Jul 23 10:31:25 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:25 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:31:25 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:26 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666" returned: 0 in 0.386s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.c8e74de4-a555-4ee0-87e5-3e628f1858c3mi_4d4e9.img {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:26 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.c8e74de4-a555-4ee0-87e5-3e628f1858c3mi_4d4e9.img Jul 23 10:31:26 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:26 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.254s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:26 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:31:26 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Deleted volume successfully. Jul 23 10:31:26 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3367b61e-27ca-4430-98a4-50abef41d779 tempest-CinderUnicodeTest-1145698037 None] Lock "cinder-944cc8ad-4a87-4c16-af35-abd34e9b900a-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:27 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-023db796-456f-49a7-9de2-da1636fa5859 tempest-GroupsTest-1191682608 None] Group tempest-GroupsTest-Group-1809115374: creating Jul 23 10:31:27 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-023db796-456f-49a7-9de2-da1636fa5859 tempest-GroupsTest-1191682608 None] Group tempest-GroupsTest-Group-1809115374: created successfully Jul 23 10:31:27 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-023db796-456f-49a7-9de2-da1636fa5859 tempest-GroupsTest-1191682608 None] Create group completed successfully. Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Flow 'volume_create_manager' (fb8d5aa8-6e07-4afa-b573-de0da0dd3929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e2207a-41eb-4427-a120-ab7f256cd38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e2207a-41eb-4427-a120-ab7f256cd38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-238084219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0abfb0f-8907-46f9-9509-c09b0594d8f0,host='devstack@QuobyteHD#QuobyteHD',id=696687ab-d996-4547-b842-f3fa9cd28fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ab2e6c098f446fa38d89b21467f871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:30Z,use_quota=True,user_id='cfe8ced7118a4502bea0b2782d03f8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e40cbee-36c2-4153-addc-4edae4d7aad5),volume_type_id=1e40cbee-36c2-4153-addc-4edae4d7aad5)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13c7fd1-7c2d-4022-a023-100377cfc847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13c7fd1-7c2d-4022-a023-100377cfc847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f7c51f-7a92-4dd0-a2af-7e88fd01f82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f7c51f-7a92-4dd0-a2af-7e88fd01f82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '696687ab-d996-4547-b842-f3fa9cd28fca', 'volume_name': 'volume-696687ab-d996-4547-b842-f3fa9cd28fca', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768a5ab8-9391-4ff7-9e8b-702e36adb01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768a5ab8-9391-4ff7-9e8b-702e36adb01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45984d8-1bc6-4972-8beb-7d67eefb5ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:30 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Volume 696687ab-d996-4547-b842-f3fa9cd28fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-696687ab-d996-4547-b842-f3fa9cd28fca', 'volume_size': 1} Jul 23 10:31:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:31 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.c8e74de4-a555-4ee0-87e5-3e628f1858c3mi_4d4e9.img" returned: 0 in 4.964s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:31 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c6a507-bcae-4bfa-8fd3-c5634ab3fab8]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:31 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 Jul 23 10:31:31 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:31 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666" returned: 0 in 0.566s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:31 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.c8e74de4-a555-4ee0-87e5-3e628f1858c3mi_4d4e9.img {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:31:31 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] Converted 1024.00 MB image at 206.25 MB/s Jul 23 10:31:31 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] c8e74de4-a555-4ee0-87e5-3e628f1858c3 was raw, no need to convert to raw {{(pid=88371) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Flow 'volume_create_manager' (cb005eb5-4009-4005-961b-a4eebfcbcaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d524bb-52be-48da-a4fa-1c44ee6f54b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d524bb-52be-48da-a4fa-1c44ee6f54b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1811201953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ab5570-9435-4d47-b1e2-513ddc9af95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6aaf78f92943209ae4dc8e33eafa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:33Z,use_quota=True,user_id='98e6ed511de54948915c94aa1b76cf47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6d4f6d-3879-4082-8471-1fd6dd71008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6d4f6d-3879-4082-8471-1fd6dd71008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d6e4b0-0eab-4879-b530-cc0db9acd304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d6e4b0-0eab-4879-b530-cc0db9acd304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ab5570-9435-4d47-b1e2-513ddc9af95a', 'volume_name': 'volume-56ab5570-9435-4d47-b1e2-513ddc9af95a', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fead20-664f-4639-8ef2-7b9f6336fbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fead20-664f-4639-8ef2-7b9f6336fbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04494187-ed26-4cdc-ac8d-fe8786f3be94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:32 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Volume 56ab5570-9435-4d47-b1e2-513ddc9af95a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ab5570-9435-4d47-b1e2-513ddc9af95a', 'volume_size': 1} Jul 23 10:31:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:42 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=62,cinder:SELECT=59,cinder:INSERT=17,cinder:DELETE=4 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:31:42 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=56,cinder:INSERT=10,cinder:UPDATE=53,cinder:DELETE=2 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:46 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:31:46 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:46 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.297s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:31:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.954s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] Uploaded volume to glance image-id: c8e74de4-a555-4ee0-87e5-3e628f1858c3. {{(pid=88371) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.913s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e0abfb0f-8907-46f9-9509-c09b0594d8f0,created_at=2026-07-23T08:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-238084219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0abfb0f-8907-46f9-9509-c09b0594d8f0,host='devstack@QuobyteHD#QuobyteHD',id=696687ab-d996-4547-b842-f3fa9cd28fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ab2e6c098f446fa38d89b21467f871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:30Z,use_quota=True,user_id='cfe8ced7118a4502bea0b2782d03f8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e40cbee-36c2-4153-addc-4edae4d7aad5),volume_type_id=1e40cbee-36c2-4153-addc-4edae4d7aad5)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Creating volume 696687ab-d996-4547-b842-f3fa9cd28fca {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:31:51 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:51 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca 1073741824 Jul 23 10:31:51 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:51 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f40b6d5b-fdbd-49d2-ba94-d14b5b665ddc tempest-VolumesActionsTest-1401708746 None] Copy volume to image completed successfully. Jul 23 10:31:51 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca 1073741824" returned: 0 in 0.453s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:51 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca Jul 23 10:31:51 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:51 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca" returned: 0 in 0.267s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.159s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1811201953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ab5570-9435-4d47-b1e2-513ddc9af95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6aaf78f92943209ae4dc8e33eafa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:33Z,use_quota=True,user_id='98e6ed511de54948915c94aa1b76cf47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Creating volume 56ab5570-9435-4d47-b1e2-513ddc9af95a {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:31:51 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45984d8-1bc6-4972-8beb-7d67eefb5ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-696687ab-d996-4547-b842-f3fa9cd28fca', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:52 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a 1073741824 Jul 23 10:31:52 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd03094b-3f55-4d4e-9512-6f54a2c70737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:52 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Volume volume-696687ab-d996-4547-b842-f3fa9cd28fca (696687ab-d996-4547-b842-f3fa9cd28fca): created successfully Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd03094b-3f55-4d4e-9512-6f54a2c70737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Flow 'volume_create_manager' (fb8d5aa8-6e07-4afa-b573-de0da0dd3929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:52 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-320d8200-bba7-4744-8ef5-b87f56221b89 tempest-GroupsTest-1191682608 None] Created volume successfully. Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:52 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a 1073741824" returned: 0 in 0.466s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:52 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a Jul 23 10:31:52 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:52 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.425s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04494187-ed26-4cdc-ac8d-fe8786f3be94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ab5570-9435-4d47-b1e2-513ddc9af95a', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4047b3-53ac-4c43-90ae-56f3ad7b6d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d920dddb-d6c1-4796-ab74-fb924a020ed4]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:52 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Volume volume-56ab5570-9435-4d47-b1e2-513ddc9af95a (56ab5570-9435-4d47-b1e2-513ddc9af95a): created successfully Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4047b3-53ac-4c43-90ae-56f3ad7b6d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Flow 'volume_create_manager' (cb005eb5-4009-4005-961b-a4eebfcbcaa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:52 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9125f20a-f99f-441f-97a8-db02fea000a7 tempest-ProjectReaderTests-2056835962 None] Created volume successfully. Jul 23 10:31:52 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 Jul 23 10:31:52 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Flow 'volume_create_manager' (392459b1-05fc-41f8-9ad6-cd38bcbae531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2283017-9f7b-4b2b-bdf9-711c7aaebe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2283017-9f7b-4b2b-bdf9-711c7aaebe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1405044812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0abfb0f-8907-46f9-9509-c09b0594d8f0,host='devstack@QuobyteHD#QuobyteHD',id=71d9fcac-79d3-4df8-a6ad-602e3e5d3e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ab2e6c098f446fa38d89b21467f871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:53Z,use_quota=True,user_id='cfe8ced7118a4502bea0b2782d03f8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e40cbee-36c2-4153-addc-4edae4d7aad5),volume_type_id=1e40cbee-36c2-4153-addc-4edae4d7aad5)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8c92f4-dd35-4e47-b9c9-09ca361180eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8c92f4-dd35-4e47-b9c9-09ca361180eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481d16e6-4242-42e8-966e-849dc1f7b032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481d16e6-4242-42e8-966e-849dc1f7b032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d9fcac-79d3-4df8-a6ad-602e3e5d3e55', 'volume_name': 'volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1db28b-7e32-4291-b559-351d64c9d4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1db28b-7e32-4291-b559-351d64c9d4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1757c081-00f3-4729-be13-fc39cdc6376b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:53 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Volume 71d9fcac-79d3-4df8-a6ad-602e3e5d3e55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55', 'volume_size': 1} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "cinder-56ab5570-9435-4d47-b1e2-513ddc9af95a-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-56ab5570-9435-4d47-b1e2-513ddc9af95a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "cinder-quobyte-56ab5570-9435-4d47-b1e2-513ddc9af95a" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-quobyte-56ab5570-9435-4d47-b1e2-513ddc9af95a" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:31:53 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666" returned: 0 in 0.480s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d179ddf-8254-4177-8bae-b41429593ce8]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb4e05f-296d-4212-b6d4-01f68e885d80]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:53 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a Jul 23 10:31:53 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:53 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 Jul 23 10:31:53 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:53 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a" returned: 0 in 0.363s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:53 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666" returned: 0 in 0.376s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:53 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a Jul 23 10:31:53 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:53 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img Jul 23 10:31:53 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:53 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-56ab5570-9435-4d47-b1e2-513ddc9af95a" returned: 0 in 0.259s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-quobyte-56ab5570-9435-4d47-b1e2-513ddc9af95a" released by "delete_volume" :: held 0.665s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:53 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Created reservations ['43c4389d-5bc8-45ba-b842-a7ab575b869b', 'efda08bc-46ec-42c2-bac3-c159994d542d', '76c0312d-fb9b-487c-9f3a-e31224ebf1bc', '2d4eef00-25ad-419f-a430-169c16f6fe6c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:31:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:31:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:31:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:31:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:31:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:54 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:31:54 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:55 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.983s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:31:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Deleted volume successfully. Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ca989c51-d764-4ee0-a469-b0eb45731063 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-56ab5570-9435-4d47-b1e2-513ddc9af95a-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Flow 'volume_create_manager' (a1964a6d-2c35-4e1b-ae88-549300ac8cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f736ea7c-2868-4b2f-b0aa-254c6962e31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f736ea7c-2868-4b2f-b0aa-254c6962e31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1646715255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d6d309-f1de-4cf0-b65f-7b8714560fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6aaf78f92943209ae4dc8e33eafa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:56Z,use_quota=True,user_id='98e6ed511de54948915c94aa1b76cf47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f677fb54-47c3-4224-93b4-230af30d38ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f677fb54-47c3-4224-93b4-230af30d38ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33050225-73e8-4cdc-8382-4068906a17f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33050225-73e8-4cdc-8382-4068906a17f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5d6d309-f1de-4cf0-b65f-7b8714560fa0', 'volume_name': 'volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f48bdc-0f85-4e3b-9f2e-cc8e7555c438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f48bdc-0f85-4e3b-9f2e-cc8e7555c438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce94bf8-3dee-433a-99b2-a23b69ec486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:31:55 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Volume b5d6d309-f1de-4cf0-b65f-7b8714560fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0', 'volume_size': 1} Jul 23 10:31:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:31:58 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img" returned: 0 in 4.455s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:58 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d41c8b-6f98-4534-abef-f643f8dea957]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:58 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 Jul 23 10:31:58 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:58 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666" returned: 0 in 0.525s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:58 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:31:58 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Converted 1024.00 MB image at 229.82 MB/s Jul 23 10:31:58 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] 898dfe98-d0a1-43c1-a764-b4b79348e152 was raw, converting to qcow2 {{(pid=88371) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 23 10:31:58 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9068bd34-7817-4f2f-a1e7-7ee22bbee39d]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:58 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img Jul 23 10:31:58 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:58 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img" returned: 0 in 0.326s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:59 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img Jul 23 10:31:59 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:59 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img" returned: 1 in 0.317s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:31:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img /opt/stack/data/cinder/conversion/vol_upload_gzcayawj {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:59 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img /opt/stack/data/cinder/conversion/vol_upload_gzcayawj Jul 23 10:31:59 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:59 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img /opt/stack/data/cinder/conversion/vol_upload_gzcayawj" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:31:59 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Image conversion details: src /opt/stack/data/cinder/conversion/97980c88-8e85-4fbb-b726-e6eaf545b666.temp_image.898dfe98-d0a1-43c1-a764-b4b79348e152jzajok6k.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_gzcayawj {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:31:59 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 23 10:31:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[668df51e-429d-44a4-b7b2-27abebad4617]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:31:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gzcayawj {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:31:59 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gzcayawj Jul 23 10:31:59 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:31:59 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 23 10:31:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gzcayawj" returned: 0 in 0.323s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.336s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Uploaded volume to glance image-id: 898dfe98-d0a1-43c1-a764-b4b79348e152. {{(pid=88371) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.928s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e0abfb0f-8907-46f9-9509-c09b0594d8f0,created_at=2026-07-23T08:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1405044812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0abfb0f-8907-46f9-9509-c09b0594d8f0,host='devstack@QuobyteHD#QuobyteHD',id=71d9fcac-79d3-4df8-a6ad-602e3e5d3e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ab2e6c098f446fa38d89b21467f871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:53Z,use_quota=True,user_id='cfe8ced7118a4502bea0b2782d03f8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e40cbee-36c2-4153-addc-4edae4d7aad5),volume_type_id=1e40cbee-36c2-4153-addc-4edae4d7aad5)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Creating volume 71d9fcac-79d3-4df8-a6ad-602e3e5d3e55 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:01 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:01 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55 1073741824 Jul 23 10:32:01 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f07b28fb-c096-4ee5-b660-77f1d9187329 tempest-VolumesActionsTest-1401708746 None] Copy volume to image completed successfully. Jul 23 10:32:01 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55 1073741824" returned: 0 in 0.392s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:01 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55 Jul 23 10:32:01 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:01 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55" returned: 0 in 0.238s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.808s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1646715255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d6d309-f1de-4cf0-b65f-7b8714560fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6aaf78f92943209ae4dc8e33eafa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:31:56Z,use_quota=True,user_id='98e6ed511de54948915c94aa1b76cf47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Creating volume b5d6d309-f1de-4cf0-b65f-7b8714560fa0 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:01 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1757c081-00f3-4729-be13-fc39cdc6376b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:01 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0 1073741824 Jul 23 10:32:01 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92b1458-1bc5-482d-8140-c5fb9db46149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:01 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Volume volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55 (71d9fcac-79d3-4df8-a6ad-602e3e5d3e55): created successfully Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92b1458-1bc5-482d-8140-c5fb9db46149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Flow 'volume_create_manager' (392459b1-05fc-41f8-9ad6-cd38bcbae531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e27ee05a-e4c2-4965-91b7-d777829961fd tempest-GroupsTest-1191682608 None] Created volume successfully. Jul 23 10:32:02 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0 1073741824" returned: 0 in 0.444s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:02 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0 Jul 23 10:32:02 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:02 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Acquiring lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0" returned: 0 in 0.260s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce94bf8-3dee-433a-99b2-a23b69ec486a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d27723-cf3c-445f-a099-264e3047c6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:02 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Volume volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0 (b5d6d309-f1de-4cf0-b65f-7b8714560fa0): created successfully Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d27723-cf3c-445f-a099-264e3047c6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Flow 'volume_create_manager' (a1964a6d-2c35-4e1b-ae88-549300ac8cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:02 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ee050c09-069f-4301-9314-b94909129f35 tempest-ProjectReaderTests-2056835962 None] Created volume successfully. Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Acquiring lock "cinder-quobyte-97980c88-8e85-4fbb-b726-e6eaf545b666" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Lock "cinder-quobyte-97980c88-8e85-4fbb-b726-e6eaf545b666" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce582771-411d-4bde-a249-7ad84d74a563]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:02 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 Jul 23 10:32:02 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:02 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666" returned: 0 in 0.354s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:03 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666 Jul 23 10:32:03 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:03 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b3f01470-616f-4ebf-bc8d-14fec6a7de1c tempest-GroupsTest-1191682608 None] Update group completed successfully. Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "cinder-b5d6d309-f1de-4cf0-b65f-7b8714560fa0-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:03 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-b5d6d309-f1de-4cf0-b65f-7b8714560fa0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-97980c88-8e85-4fbb-b726-e6eaf545b666" returned: 0 in 0.324s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Lock "cinder-quobyte-97980c88-8e85-4fbb-b726-e6eaf545b666" released by "delete_volume" :: held 0.713s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "cinder-quobyte-b5d6d309-f1de-4cf0-b65f-7b8714560fa0" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-quobyte-b5d6d309-f1de-4cf0-b65f-7b8714560fa0" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Created reservations ['cf7a3fa0-4073-438c-9ab4-ad67c18b984e', 'b88cf7bf-151f-455b-8ef4-b12e78e8bbba', '7c26a541-bf46-4b7f-9b85-cbacbd8d8621', 'd2696fcd-d290-49b1-b9a4-42308cd56f09'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3095a9e7-9059-4b67-b28e-794f69854fbc]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:03 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:03 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:03 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0 Jul 23 10:32:03 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:03 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:03 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Deleted volume successfully. Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ae26014d-b263-4591-a7d2-e9ee3adcba7d tempest-VolumesActionsTest-1401708746 None] Lock "cinder-97980c88-8e85-4fbb-b726-e6eaf545b666-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:03 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0" returned: 0 in 0.377s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:03 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0 Jul 23 10:32:03 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:04 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b5d6d309-f1de-4cf0-b65f-7b8714560fa0" returned: 0 in 0.261s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-quobyte-b5d6d309-f1de-4cf0-b65f-7b8714560fa0" released by "delete_volume" :: held 0.683s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Created reservations ['766f5a32-64ac-4262-84b0-bc28985d52f9', '0c2c40b6-ed2b-48f3-b199-d23b88a1dd7e', '056d4a31-21d3-4ebe-970d-e8aa88fe3c35', '60820270-ba40-4bc1-9763-d5383780585c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:04 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:04 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7ff40a8a-ab53-4548-8c2d-dc6265ac4a28 tempest-GroupsTest-1191682608 None] Update group completed successfully. Jul 23 10:32:04 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.343s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Deleted volume successfully. Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59bb8742-1fc8-4df6-bc59-696e6a6562f5 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-b5d6d309-f1de-4cf0-b65f-7b8714560fa0-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Flow 'volume_create_manager' (7df71f1e-b16b-4203-b99d-496c967056ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ca978b-52f2-451a-98e5-ae5421f418be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ca978b-52f2-451a-98e5-ae5421f418be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161505124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7024da0-702f-40d2-ad13-be25470a6f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6aaf78f92943209ae4dc8e33eafa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:05Z,use_quota=True,user_id='98e6ed511de54948915c94aa1b76cf47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58300297-d690-4e59-af93-f986a8c25ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58300297-d690-4e59-af93-f986a8c25ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b303a6-68c2-47d0-98d1-a7fcc93fed83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b303a6-68c2-47d0-98d1-a7fcc93fed83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7024da0-702f-40d2-ad13-be25470a6f11', 'volume_name': 'volume-b7024da0-702f-40d2-ad13-be25470a6f11', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f59e67c-aacf-4aad-8943-1bc4b95ff2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f59e67c-aacf-4aad-8943-1bc4b95ff2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbd4a0e-d8fb-45b5-9168-6e6fb709ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:05 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Volume b7024da0-702f-40d2-ad13-be25470a6f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7024da0-702f-40d2-ad13-be25470a6f11', 'volume_size': 1} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161505124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7024da0-702f-40d2-ad13-be25470a6f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6aaf78f92943209ae4dc8e33eafa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:05Z,use_quota=True,user_id='98e6ed511de54948915c94aa1b76cf47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Creating volume b7024da0-702f-40d2-ad13-be25470a6f11 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:05 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:05 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11 1073741824 Jul 23 10:32:05 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:05 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11 1073741824" returned: 0 in 0.424s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:05 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11 Jul 23 10:32:05 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:05 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11" returned: 0 in 0.270s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbd4a0e-d8fb-45b5-9168-6e6fb709ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7024da0-702f-40d2-ad13-be25470a6f11', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7c85f0-27a9-4d86-93d5-09cb90b8ccef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:05 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Volume volume-b7024da0-702f-40d2-ad13-be25470a6f11 (b7024da0-702f-40d2-ad13-be25470a6f11): created successfully Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7c85f0-27a9-4d86-93d5-09cb90b8ccef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Flow 'volume_create_manager' (7df71f1e-b16b-4203-b99d-496c967056ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:05 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a2b06f04-881b-4319-82cd-1785e628ffa0 tempest-ProjectReaderTests-2056835962 None] Created volume successfully. Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "cinder-b7024da0-702f-40d2-ad13-be25470a6f11-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-b7024da0-702f-40d2-ad13-be25470a6f11-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "cinder-quobyte-b7024da0-702f-40d2-ad13-be25470a6f11" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-quobyte-b7024da0-702f-40d2-ad13-be25470a6f11" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c42b80-9509-4711-8e8c-f6bb15051822]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Acquiring lock "cinder-quobyte-696687ab-d996-4547-b842-f3fa9cd28fca" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Lock "cinder-quobyte-696687ab-d996-4547-b842-f3fa9cd28fca" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7f151b-9300-459c-94d1-b8589486d7f0]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:06 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11 Jul 23 10:32:06 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:06 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca Jul 23 10:32:06 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:06 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11" returned: 0 in 0.465s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:06 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11 Jul 23 10:32:06 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:06 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca" returned: 0 in 0.433s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:06 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca Jul 23 10:32:06 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:06 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b7024da0-702f-40d2-ad13-be25470a6f11" returned: 0 in 0.285s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-quobyte-b7024da0-702f-40d2-ad13-be25470a6f11" released by "delete_volume" :: held 0.801s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:06 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-696687ab-d996-4547-b842-f3fa9cd28fca" returned: 0 in 0.273s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Created reservations ['4637d8b1-92d7-4e6a-b5be-50269eba4f64', '5f6481cc-0bbf-4650-a820-d029716cbd00', '7942336b-3904-4b03-b934-d68f5d3f4674', '0de49dcb-e6a6-421f-a988-53b5732b6648'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Lock "cinder-quobyte-696687ab-d996-4547-b842-f3fa9cd28fca" released by "delete_volume" :: held 0.760s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Acquiring lock "cinder-quobyte-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Lock "cinder-quobyte-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4d4662-4270-494e-8547-13520acd0e53]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:07 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:07 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:07 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55 Jul 23 10:32:07 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:07 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.364s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Deleted volume successfully. Jul 23 10:32:07 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a780c7f9-0747-4fab-95c6-93136b7f2117 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-b7024da0-702f-40d2-ad13-be25470a6f11-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55" returned: 0 in 0.476s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:07 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55 Jul 23 10:32:07 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:07 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Flow 'volume_create_manager' (495bb6ab-048d-477d-b730-4b58cadcc482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02a9e0e-48ad-4ccd-9b62-01a82b443fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55" returned: 0 in 0.379s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02a9e0e-48ad-4ccd-9b62-01a82b443fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-660639384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfca4677-fb47-4645-a73c-2d847b01df1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6aaf78f92943209ae4dc8e33eafa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:08Z,use_quota=True,user_id='98e6ed511de54948915c94aa1b76cf47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b9e84e-39ba-4d73-b76a-c1ae4ccf26b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b9e84e-39ba-4d73-b76a-c1ae4ccf26b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57be0a5c-944f-4965-a4ce-207a0f083adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57be0a5c-944f-4965-a4ce-207a0f083adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfca4677-fb47-4645-a73c-2d847b01df1b', 'volume_name': 'volume-dfca4677-fb47-4645-a73c-2d847b01df1b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dc4c90-83bc-49e8-afba-b3c81674a545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dc4c90-83bc-49e8-afba-b3c81674a545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b92270b-8680-4f57-8c0c-6cf823481d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:07 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Volume dfca4677-fb47-4645-a73c-2d847b01df1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfca4677-fb47-4645-a73c-2d847b01df1b', 'volume_size': 1} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-660639384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfca4677-fb47-4645-a73c-2d847b01df1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6aaf78f92943209ae4dc8e33eafa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:08Z,use_quota=True,user_id='98e6ed511de54948915c94aa1b76cf47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Creating volume dfca4677-fb47-4645-a73c-2d847b01df1b {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:07 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Lock "cinder-quobyte-71d9fcac-79d3-4df8-a6ad-602e3e5d3e55" released by "delete_volume" :: held 0.970s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:08 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b 1073741824 Jul 23 10:32:08 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Created reservations ['7b1ca46c-7c5c-478c-bc12-5eb4916a8554'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:08 devstack cinder-volume[88371]: WARNING cinder.quota [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-332614450 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-332614450, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:32:08 devstack cinder-volume[88371]: WARNING cinder.quota [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-332614450 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-332614450, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Created reservations ['f1442f13-93ef-4532-bf96-d5c24cd6dd65', '7ae0b3ab-7e8a-4059-a9e4-fa4ad806a54f', 'a2ae5dd7-2ae3-4717-8918-f8517d2ea597', 'd22fbf4f-4112-48ad-bcaa-4714bf80da2c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Created reservations ['da73573a-f431-4cf2-b77c-e3c6e9c56e80', 'ba2bbf21-7d21-4146-86ee-b0c139065209', '9d7347f6-389b-43b4-9761-9e6eeb62d99d', '4abfcca7-51d2-4bde-833f-4dd14a7c780c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:08 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:08 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:08 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b 1073741824" returned: 0 in 0.510s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:08 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b Jul 23 10:32:08 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:08 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.287s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:08 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-bbbe36bc-f1fa-43fc-b5d6-759a67cfefe3 tempest-GroupsTest-1191682608 None] Delete group completed successfully. Jul 23 10:32:08 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b" returned: 0 in 0.322s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b92270b-8680-4f57-8c0c-6cf823481d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfca4677-fb47-4645-a73c-2d847b01df1b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391fdd75-96c4-4703-a9ab-b74ce4e526de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:08 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Volume volume-dfca4677-fb47-4645-a73c-2d847b01df1b (dfca4677-fb47-4645-a73c-2d847b01df1b): created successfully Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391fdd75-96c4-4703-a9ab-b74ce4e526de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Flow 'volume_create_manager' (495bb6ab-048d-477d-b730-4b58cadcc482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:08 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1db076c5-d051-4ccb-8b16-6ff6b1518ae4 tempest-ProjectReaderTests-2056835962 None] Created volume successfully. Jul 23 10:32:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "cinder-dfca4677-fb47-4645-a73c-2d847b01df1b-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-dfca4677-fb47-4645-a73c-2d847b01df1b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "cinder-quobyte-dfca4677-fb47-4645-a73c-2d847b01df1b" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-quobyte-dfca4677-fb47-4645-a73c-2d847b01df1b" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d022b6-d78e-47fc-9fe4-d13bd8fb291b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:10 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b Jul 23 10:32:10 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Flow 'volume_create_manager' (9966b80f-4b64-4e76-8859-eaddde154d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1b4d01-b8d8-4b38-ae40-eeae1516de6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1b4d01-b8d8-4b38-ae40-eeae1516de6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1107463287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5463136-6ba9-470a-b173-2c03c188105e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225a91b129504fb28f48c9bc3b8fb7a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:10Z,use_quota=True,user_id='f38b8f0c7b1e4e36ad48a6dc088a99b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab17d05-e8e1-413f-9f64-0537e1a06ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab17d05-e8e1-413f-9f64-0537e1a06ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e06de2a-1cfb-4fff-8f51-977398a89e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e06de2a-1cfb-4fff-8f51-977398a89e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5463136-6ba9-470a-b173-2c03c188105e', 'volume_name': 'volume-a5463136-6ba9-470a-b173-2c03c188105e', 'volume_size': 2}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:10 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07779a6c-5b0e-4b72-a285-7cf34ebaabf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07779a6c-5b0e-4b72-a285-7cf34ebaabf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9c158c-ac46-414f-820d-ee59c032329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:10 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Volume a5463136-6ba9-470a-b173-2c03c188105e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5463136-6ba9-470a-b173-2c03c188105e', 'volume_size': 2} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1107463287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5463136-6ba9-470a-b173-2c03c188105e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225a91b129504fb28f48c9bc3b8fb7a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:10Z,use_quota=True,user_id='f38b8f0c7b1e4e36ad48a6dc088a99b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Creating volume a5463136-6ba9-470a-b173-2c03c188105e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:10 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e 2147483648 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b" returned: 0 in 0.514s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:10 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e 2147483648 Jul 23 10:32:10 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:10 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b Jul 23 10:32:10 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:10 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dfca4677-fb47-4645-a73c-2d847b01df1b" returned: 0 in 0.321s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-quobyte-dfca4677-fb47-4645-a73c-2d847b01df1b" released by "delete_volume" :: held 0.884s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Created reservations ['ec52b733-e538-4809-bcbd-7ecc881a8ee4', '602bc1f4-b515-4354-b1ed-94745a42a00e', '8b97908e-8563-42ee-a93c-1933552e51fd', '5aca15ae-3148-44a1-bf19-184285da464d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:11 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:11 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:11 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e 2147483648" returned: 0 in 0.624s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:11 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e Jul 23 10:32:11 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:11 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.352s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:11 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Deleted volume successfully. Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed99b816-114f-4898-8b21-ba5fc35bc572 tempest-ProjectReaderTests-2056835962 None] Lock "cinder-dfca4677-fb47-4645-a73c-2d847b01df1b-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:11 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e" returned: 0 in 0.357s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9c158c-ac46-414f-820d-ee59c032329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5463136-6ba9-470a-b173-2c03c188105e', 'volume_size': 2}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d2d26b-769a-4881-ac7f-f93798a55fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:11 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Volume volume-a5463136-6ba9-470a-b173-2c03c188105e (a5463136-6ba9-470a-b173-2c03c188105e): created successfully Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d2d26b-769a-4881-ac7f-f93798a55fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Flow 'volume_create_manager' (9966b80f-4b64-4e76-8859-eaddde154d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:11 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e3e98dea-e840-4b6f-aa27-8cb611acfddb tempest-VolumesCloneNegativeTest-403903823 None] Created volume successfully. Jul 23 10:32:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Acquiring lock "cinder-a5463136-6ba9-470a-b173-2c03c188105e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Lock "cinder-a5463136-6ba9-470a-b173-2c03c188105e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Acquiring lock "cinder-quobyte-a5463136-6ba9-470a-b173-2c03c188105e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Lock "cinder-quobyte-a5463136-6ba9-470a-b173-2c03c188105e" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:12 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c78425-a7a8-482f-b0b2-84597b1b0f7e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:13 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e Jul 23 10:32:13 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:13 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e" returned: 0 in 0.392s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:13 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e Jul 23 10:32:13 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:13 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a5463136-6ba9-470a-b173-2c03c188105e" returned: 0 in 0.252s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Lock "cinder-quobyte-a5463136-6ba9-470a-b173-2c03c188105e" released by "delete_volume" :: held 0.697s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:13 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Created reservations ['92b8173c-33ba-4124-93d5-e87a15f5a9e0', '92947be2-71ef-4dee-b306-afefa2beddbe', '88d5f2f9-0590-4cd6-8dbc-97a2e534e554', 'fd6fa4f0-3308-4c6c-b0cb-54efe247b112'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:13 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:13 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:14 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.284s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:14 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:14 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Deleted volume successfully. Jul 23 10:32:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e1ca5e00-f603-41ba-a358-3933589eff0a tempest-VolumesCloneNegativeTest-403903823 None] Lock "cinder-a5463136-6ba9-470a-b173-2c03c188105e-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:14 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fbfef8b6-b931-4a81-9f3d-1d88c1545955 tempest-GroupsV314Test-930948653 None] Group tempest-GroupsV314Test-Group-1233412581: creating Jul 23 10:32:14 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fbfef8b6-b931-4a81-9f3d-1d88c1545955 tempest-GroupsV314Test-930948653 None] Group tempest-GroupsV314Test-Group-1233412581: created successfully Jul 23 10:32:14 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fbfef8b6-b931-4a81-9f3d-1d88c1545955 tempest-GroupsV314Test-930948653 None] Create group completed successfully. Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Flow 'volume_create_manager' (21db9b32-22aa-4228-8160-d44d69969155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2101e9-f855-4490-b1b7-0d0ae189368f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2101e9-f855-4490-b1b7-0d0ae189368f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-113543386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05a5c037-6f62-45f9-a928-2e7bca2561e2,host='devstack@QuobyteHD#QuobyteHD',id=7c78408a-d075-4e2c-9771-21b5a0f2b4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bffd79d6a774d9dac5471386c87aa5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:16Z,use_quota=True,user_id='40ef0cb71c3d43c8b857f7fb4fc146cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b7ea810-cecf-4f11-90b6-229cfac2600a),volume_type_id=7b7ea810-cecf-4f11-90b6-229cfac2600a)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de079fd2-09e5-403d-b4ee-472bae45db85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de079fd2-09e5-403d-b4ee-472bae45db85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5578af6f-63d6-402c-a2ac-471654ae2e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5578af6f-63d6-402c-a2ac-471654ae2e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c78408a-d075-4e2c-9771-21b5a0f2b4ec', 'volume_name': 'volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2df935-e249-4a6e-bd5e-9e92b34b669b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2df935-e249-4a6e-bd5e-9e92b34b669b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329745a6-2cbc-40db-9d3e-9cf1759fc1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:16 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Volume 7c78408a-d075-4e2c-9771-21b5a0f2b4ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec', 'volume_size': 1} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05a5c037-6f62-45f9-a928-2e7bca2561e2,created_at=2026-07-23T08:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-113543386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05a5c037-6f62-45f9-a928-2e7bca2561e2,host='devstack@QuobyteHD#QuobyteHD',id=7c78408a-d075-4e2c-9771-21b5a0f2b4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bffd79d6a774d9dac5471386c87aa5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:16Z,use_quota=True,user_id='40ef0cb71c3d43c8b857f7fb4fc146cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b7ea810-cecf-4f11-90b6-229cfac2600a),volume_type_id=7b7ea810-cecf-4f11-90b6-229cfac2600a)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Creating volume 7c78408a-d075-4e2c-9771-21b5a0f2b4ec {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:16 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:16 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec 1073741824 Jul 23 10:32:16 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:17 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec 1073741824" returned: 0 in 0.507s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:17 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec Jul 23 10:32:17 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:17 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec" returned: 0 in 0.309s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329745a6-2cbc-40db-9d3e-9cf1759fc1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc25682-bbd2-4779-be79-5b592d78ddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:17 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Volume volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec (7c78408a-d075-4e2c-9771-21b5a0f2b4ec): created successfully Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc25682-bbd2-4779-be79-5b592d78ddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Flow 'volume_create_manager' (21db9b32-22aa-4228-8160-d44d69969155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (a52d2dcc-f38b-4098-b2c8-8bb40f578ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c587e8-8085-4917-a043-17ffecd0e9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-69f585c6-062f-41da-b3f6-4ea127d7b366 tempest-GroupsV314Test-930948653 None] Created volume successfully. Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c587e8-8085-4917-a043-17ffecd0e9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-814470223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:17Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8f8681-8155-4c55-84d3-fe5d163b8a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8f8681-8155-4c55-84d3-fe5d163b8a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3296a83c-c7f4-4a08-a112-407c1afe88b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3296a83c-c7f4-4a08-a112-407c1afe88b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e', 'volume_name': 'volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b549037-9135-4dc6-843a-c87b041f26f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b549037-9135-4dc6-843a-c87b041f26f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28287e38-6dce-44f2-8dec-1fe4ecc7e5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:17 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Volume e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e', 'volume_size': 1} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-814470223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:17Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Creating volume e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:17 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:17 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e 1073741824 Jul 23 10:32:17 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:18 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e 1073741824" returned: 0 in 0.602s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:18 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e Jul 23 10:32:18 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:18 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e" returned: 0 in 0.276s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.059s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:18 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Cloning volume 7c78408a-d075-4e2c-9771-21b5a0f2b4ec to volume d83cd650-b9f6-43af-b464-092a3fbfdb52 Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28287e38-6dce-44f2-8dec-1fe4ecc7e5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75404ec2-6bfa-4b6d-a4f7-14fa92c26447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Creating offline snapshot 027afdae-eb4a-4fcd-968c-77a831f07879 of volume 7c78408a-d075-4e2c-9771-21b5a0f2b4ec {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:32:18 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Volume volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e (e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e): created successfully Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75404ec2-6bfa-4b6d-a4f7-14fa92c26447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (a52d2dcc-f38b-4098-b2c8-8bb40f578ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae89be7-5b36-4888-ada0-ec0434dbe025]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:18 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-2f8a29b0-52fd-4fb2-86da-94c355d06819 tempest-VolumesGetTest-532753094 None] Created volume successfully. Jul 23 10:32:18 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec Jul 23 10:32:18 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:19 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:19 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 1G Jul 23 10:32:19 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:19 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 1G" returned: 0 in 0.543s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:19 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 Jul 23 10:32:19 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:19 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879" returned: 0 in 0.358s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:19 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:32:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:19 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 Jul 23 10:32:19 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:20 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879" returned: 0 in 0.320s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:20 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.info Jul 23 10:32:20 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (fdd077d1-9774-4e04-a978-4d96daaf6fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eef5472-0402-42d2-8548-3bbd81d03949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eef5472-0402-42d2-8548-3bbd81d03949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1862344546',display_name='tempest-VolumesGetTest-Volume-1051905140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb524d32-d96a-4ff1-b078-84cbf4e9e602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:20Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7c952e-2a2f-46cb-b5cd-708c95973e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7c952e-2a2f-46cb-b5cd-708c95973e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16312d3c-d9e5-412b-8f4a-ee5eeed63b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16312d3c-d9e5-412b-8f4a-ee5eeed63b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb524d32-d96a-4ff1-b078-84cbf4e9e602', 'volume_name': 'volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d8448d-f853-4f07-b00f-debaeaea3dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d8448d-f853-4f07-b00f-debaeaea3dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734e0c8a-2612-4a40-a265-68d498404730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:20 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Volume bb524d32-d96a-4ff1-b078-84cbf4e9e602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602', 'volume_size': 1} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:20 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.info" returned: 0 in 0.297s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:20 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:20 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.info Jul 23 10:32:20 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:20 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.info" returned: 0 in 0.237s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Acquiring lock "cinder-quobyte-d83cd650-b9f6-43af-b464-092a3fbfdb52" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Lock "cinder-quobyte-d83cd650-b9f6-43af-b464-092a3fbfdb52" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] snapshot: 027afdae-eb4a-4fcd-968c-77a831f07879, volume: d83cd650-b9f6-43af-b464-092a3fbfdb52, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[565bf365-83ca-41a6-a2ff-b912dbd1070a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:21 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 Jul 23 10:32:21 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:21 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879" returned: 0 in 0.400s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:32:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:32:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:32:21 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e2fa74-c1c8-420e-a5db-4b19361e169d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:21 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec Jul 23 10:32:21 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:21 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec" returned: 0 in 0.403s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:21 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52 not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:32:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:21 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52 Jul 23 10:32:21 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:26 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52" returned: 0 in 5.037s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:26 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdbef22-8718-48b7-b46c-94bdf1ea8202]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:26 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec Jul 23 10:32:26 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:27 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec" returned: 0 in 0.675s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:27 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:32:27 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Converted 1024.00 MB image at 203.26 MB/s Jul 23 10:32:27 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 10:32:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:27 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52 Jul 23 10:32:27 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:27 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52" returned: 0 in 0.248s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Lock "cinder-quobyte-d83cd650-b9f6-43af-b464-092a3fbfdb52" released by "_copy_volume_from_snapshot" :: held 6.892s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Acquiring lock "cinder-quobyte-027afdae-eb4a-4fcd-968c-77a831f07879" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:27 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Lock "cinder-quobyte-027afdae-eb4a-4fcd-968c-77a831f07879" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Deleting offline snapshot 027afdae-eb4a-4fcd-968c-77a831f07879 of volume 7c78408a-d075-4e2c-9771-21b5a0f2b4ec {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:32:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] snapshot_file for this snap is: volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:32:27 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6754a6b-92c0-49e3-b6ad-2ee0bf68c16f]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:27 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 Jul 23 10:32:27 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:28 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879" returned: 0 in 0.372s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:32:28 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[0111ca27-dc51-4d09-8149-3560d3469349]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:28 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec Jul 23 10:32:28 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:28 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec" returned: 0 in 0.371s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:28 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 Jul 23 10:32:28 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:28 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879" returned: 0 in 0.372s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:28 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879 Jul 23 10:32:28 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:29 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec.027afdae-eb4a-4fcd-968c-77a831f07879" returned: 0 in 0.273s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Lock "cinder-quobyte-027afdae-eb4a-4fcd-968c-77a831f07879" released by "_delete_snapshot" :: held 1.483s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.735s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.829s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1862344546',display_name='tempest-VolumesGetTest-Volume-1051905140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb524d32-d96a-4ff1-b078-84cbf4e9e602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:20Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Creating volume bb524d32-d96a-4ff1-b078-84cbf4e9e602 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:29 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:29 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602 1073741824 Jul 23 10:32:29 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:29 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-dd6d8c1a-420a-44dd-8a5d-e95c63291af1 tempest-GroupsV314Test-930948653 None] Create group from source-group-05a5c037-6f62-45f9-a928-2e7bca2561e2 completed successfully. Jul 23 10:32:29 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602 1073741824" returned: 0 in 0.449s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:29 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602 Jul 23 10:32:29 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:30 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602" returned: 0 in 0.273s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734e0c8a-2612-4a40-a265-68d498404730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcc195d-a2a1-4abf-acfa-7b93562fb0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:30 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Volume volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602 (bb524d32-d96a-4ff1-b078-84cbf4e9e602): created successfully Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcc195d-a2a1-4abf-acfa-7b93562fb0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (fdd077d1-9774-4e04-a978-4d96daaf6fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:30 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-19cbf13a-81cf-4575-a245-e66c60fb8d00 tempest-VolumesGetTest-532753094 None] Created volume successfully. Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-bb524d32-d96a-4ff1-b078-84cbf4e9e602-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Lock "cinder-bb524d32-d96a-4ff1-b078-84cbf4e9e602-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-quobyte-bb524d32-d96a-4ff1-b078-84cbf4e9e602" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-bb524d32-d96a-4ff1-b078-84cbf4e9e602" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0fbd98-31af-491d-96e2-27fa460c5de1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Acquiring lock "cinder-quobyte-d83cd650-b9f6-43af-b464-092a3fbfdb52" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:30 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602 Jul 23 10:32:30 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Lock "cinder-quobyte-d83cd650-b9f6-43af-b464-092a3fbfdb52" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a27283-adb2-46c5-8cee-c2584362ebfb]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:30 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52 Jul 23 10:32:30 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:31 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602" returned: 0 in 0.429s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:31 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602 Jul 23 10:32:31 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:31 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52" returned: 0 in 0.419s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:31 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52 Jul 23 10:32:31 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:31 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bb524d32-d96a-4ff1-b078-84cbf4e9e602" returned: 0 in 0.281s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-bb524d32-d96a-4ff1-b078-84cbf4e9e602" released by "delete_volume" :: held 0.764s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Created reservations ['628328c0-d7b7-453b-88d3-365ea122fec9', '5bed35f1-1edc-491a-888d-30f012dddbeb', '5caa6de1-38d2-442c-9ddb-0fa16b6ba07b', '6dd158a6-abfb-49f7-a29f-3cba12aa185c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:31 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d83cd650-b9f6-43af-b464-092a3fbfdb52" returned: 0 in 0.325s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:31 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:31 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Lock "cinder-quobyte-d83cd650-b9f6-43af-b464-092a3fbfdb52" released by "delete_volume" :: held 0.809s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Created reservations ['1a04a2ed-cf91-4352-ba31-c9079f8db56c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:31 devstack cinder-volume[88371]: WARNING cinder.quota [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-905086324 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-905086324, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:32:31 devstack cinder-volume[88371]: WARNING cinder.quota [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-905086324 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-905086324, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Created reservations ['caadfb03-1eec-4601-87b7-52dbe319b61d', '9b2693d3-bde2-4d35-bad4-76a41392c3c5', '9f43f963-5f6f-4b68-9209-aa5399008a12', '7390e898-9f06-42ac-a9a0-6c863f563122'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:31 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.337s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:31 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Deleted volume successfully. Jul 23 10:32:31 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:31 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Lock "cinder-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fcab97c7-04db-4840-9980-5442f5f7e0b4 tempest-VolumesGetTest-532753094 None] Lock "cinder-bb524d32-d96a-4ff1-b078-84cbf4e9e602-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-quobyte-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27a0a81-7b54-48aa-a513-e57d6aa572e0]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:32 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e Jul 23 10:32:32 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:32 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.327s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:32 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9684e87f-e1dd-4ec3-9929-f4b400092ce8 tempest-GroupsV314Test-930948653 None] Delete group completed successfully. Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Acquiring lock "cinder-quobyte-7c78408a-d075-4e2c-9771-21b5a0f2b4ec" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Lock "cinder-quobyte-7c78408a-d075-4e2c-9771-21b5a0f2b4ec" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c0fef9-f0c0-4c8b-b6d5-fd01b6f6c780]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:32 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:32 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e Jul 23 10:32:32 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:32 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec Jul 23 10:32:32 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:32 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e" returned: 0 in 0.267s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e" released by "delete_volume" :: held 0.705s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Created reservations ['7da6104d-16a0-499c-87d9-88304ad4a409', '7f3a4244-fb40-4e84-a99d-4961346e7e33', '2fd0559e-d501-47cf-8b10-762d282b5cba', '97508c41-fbab-4393-88ca-ad126955d091'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:32 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec" returned: 0 in 0.400s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:32 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec Jul 23 10:32:32 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:32 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:32 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:33 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.332s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:33 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Deleted volume successfully. Jul 23 10:32:33 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd3497d9-b0ea-4591-bfcf-6a0dc696f462 tempest-VolumesGetTest-532753094 None] Lock "cinder-e1424c2b-fcd8-40f2-8a0e-32bf818a8d5e-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7c78408a-d075-4e2c-9771-21b5a0f2b4ec" returned: 0 in 0.507s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Lock "cinder-quobyte-7c78408a-d075-4e2c-9771-21b5a0f2b4ec" released by "delete_volume" :: held 0.965s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Created reservations ['c1d64085-1d42-476c-a63d-5e33c0988c09'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Created reservations ['e98affea-ff36-496d-a640-a468f0db5c25', 'dd85a08b-5c9a-4b68-97ea-97414ad2ed27', '12ebc2ec-0f24-4b1d-8376-dcb66d2a17d0', 'd2bcf51e-02e8-4c6c-b72d-8a47be7fc78d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:33 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:33 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (fe4619d9-d52a-4d97-a898-134308d33b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbb5d06-44e7-4fdb-9cbc-fe2aedf51d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbb5d06-44e7-4fdb-9cbc-fe2aedf51d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-197339716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0310361-4822-429f-9db4-3f141ea0cac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:34Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1a03ed-6257-47e4-8814-d92d2916e7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1a03ed-6257-47e4-8814-d92d2916e7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddba38c-879d-42dc-8444-c4a3ed60081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddba38c-879d-42dc-8444-c4a3ed60081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0310361-4822-429f-9db4-3f141ea0cac9', 'volume_name': 'volume-a0310361-4822-429f-9db4-3f141ea0cac9', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264be9cb-aa5a-4a66-b95c-4b2277cce20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264be9cb-aa5a-4a66-b95c-4b2277cce20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b42b240-c2b0-4475-986d-19b3ef2e972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:33 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Volume a0310361-4822-429f-9db4-3f141ea0cac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0310361-4822-429f-9db4-3f141ea0cac9', 'volume_size': 1} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-197339716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0310361-4822-429f-9db4-3f141ea0cac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:34Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Creating volume a0310361-4822-429f-9db4-3f141ea0cac9 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:33 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:33 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 1073741824 Jul 23 10:32:33 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:33 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.274s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:33 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:33 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8187c522-add4-4bf2-b1a5-4945cb4560e7 tempest-GroupsV314Test-930948653 None] Delete group completed successfully. Jul 23 10:32:34 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 1073741824" returned: 0 in 0.466s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:34 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 Jul 23 10:32:34 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:34 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9" returned: 0 in 0.260s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b42b240-c2b0-4475-986d-19b3ef2e972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0310361-4822-429f-9db4-3f141ea0cac9', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82ef12d-bb65-4481-86f3-4c01ce806149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:34 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Volume volume-a0310361-4822-429f-9db4-3f141ea0cac9 (a0310361-4822-429f-9db4-3f141ea0cac9): created successfully Jul 23 10:32:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82ef12d-bb65-4481-86f3-4c01ce806149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (fe4619d9-d52a-4d97-a898-134308d33b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:34 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c67ce5b0-fb93-4991-8ce9-3185a0c51027 tempest-VolumesGetTest-532753094 None] Created volume successfully. Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (80c7416d-eb22-4655-b5b8-416132c7076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5c774a-fbea-45ab-b070-44dcae4ec1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5c774a-fbea-45ab-b070-44dcae4ec1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-616035866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594a1de7-240e-430d-b827-bcee640f83f9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a0310361-4822-429f-9db4-3f141ea0cac9,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:36Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1230729a-1588-4dd3-9f98-d3c9874a64c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1230729a-1588-4dd3-9f98-d3c9874a64c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fa7a5c-5b4a-456d-9e37-b1bc6ab56a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fa7a5c-5b4a-456d-9e37-b1bc6ab56a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '594a1de7-240e-430d-b827-bcee640f83f9', 'volume_name': 'volume-594a1de7-240e-430d-b827-bcee640f83f9', 'volume_size': 1, 'source_volid': 'a0310361-4822-429f-9db4-3f141ea0cac9', 'source_volstatus': 'available'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566ef250-96b1-4322-8a3c-edb0b83d9568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566ef250-96b1-4322-8a3c-edb0b83d9568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bec8dd0-af6a-41c1-b727-8279eeef89db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:36 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Volume 594a1de7-240e-430d-b827-bcee640f83f9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-594a1de7-240e-430d-b827-bcee640f83f9', 'volume_size': 1, 'source_volid': 'a0310361-4822-429f-9db4-3f141ea0cac9', 'source_volstatus': 'available'} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:36 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Cloning volume a0310361-4822-429f-9db4-3f141ea0cac9 to volume 594a1de7-240e-430d-b827-bcee640f83f9 Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Creating offline snapshot f1bc8a15-4c03-430f-a890-dea1d33b86a8 of volume a0310361-4822-429f-9db4-3f141ea0cac9 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee525b61-2e5c-4baa-9310-f67c6833546d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:36 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 Jul 23 10:32:36 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:36 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9" returned: 0 in 0.409s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:37 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 1G Jul 23 10:32:37 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:37 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 1G" returned: 0 in 0.483s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0310361-4822-429f-9db4-3f141ea0cac9 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:37 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0310361-4822-429f-9db4-3f141ea0cac9 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 Jul 23 10:32:37 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Flow 'volume_create_manager' (a269fc04-49df-4599-9168-b48392961056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc85bb9-6193-4f3f-9222-b03db25d8439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc85bb9-6193-4f3f-9222-b03db25d8439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1378200083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f757ec6dadf046b2988b5a6b35b0d672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:37Z,use_quota=True,user_id='f992354374db4cdf852ce9d34e257436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7278f787-335c-42ee-8ee9-1c37d8442648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7278f787-335c-42ee-8ee9-1c37d8442648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ff2d41-fb1e-4ed3-92d1-6f3a6e9980d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ff2d41-fb1e-4ed3-92d1-6f3a6e9980d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e', 'volume_name': 'volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d08bcd-1e8e-4513-a570-05c0413371ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d08bcd-1e8e-4513-a570-05c0413371ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380cfa7a-eae5-42d6-864c-6ed9ee686634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:37 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Volume 8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e', 'volume_size': 1} Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:37 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0310361-4822-429f-9db4-3f141ea0cac9 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8" returned: 0 in 0.355s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:37 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 is being set with open permissions: ugo+rw Jul 23 10:32:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:37 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 Jul 23 10:32:37 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:38 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8" returned: 0 in 0.245s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:38 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.info Jul 23 10:32:38 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:38 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.info" returned: 0 in 0.288s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:38 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.info is being set with open permissions: ugo+rw Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:38 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.info Jul 23 10:32:38 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:38 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.info" returned: 0 in 0.260s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-quobyte-594a1de7-240e-430d-b827-bcee640f83f9" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-594a1de7-240e-430d-b827-bcee640f83f9" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] snapshot: f1bc8a15-4c03-430f-a890-dea1d33b86a8, volume: 594a1de7-240e-430d-b827-bcee640f83f9, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31c4e57-c3d1-4b24-a98c-e1991e924cb0]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:38 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 Jul 23 10:32:38 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:39 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8" returned: 0 in 0.369s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:39 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0310361-4822-429f-9db4-3f141ea0cac9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:32:39 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:32:39 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:32:39 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6cc493-b723-4f22-ab11-53e865629f4f]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:39 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 Jul 23 10:32:39 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:39 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9" returned: 0 in 0.425s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:39 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9 not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:32:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:39 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9 Jul 23 10:32:39 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Flow 'volume_create_manager' (0319724a-3aa0-4440-a5b9-21b4636bd0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e507db-a4f4-44d6-9442-a19639e79e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e507db-a4f4-44d6-9442-a19639e79e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-166301152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4991ef87-8aa9-49f0-b851-fdd5bd88027b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='333c6943fb3841358863912b2d6b82f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:40Z,use_quota=True,user_id='469451c282ab4dbb9f497d36b24655da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fdcb3e-6120-4f2b-84c7-36ce36f327e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fdcb3e-6120-4f2b-84c7-36ce36f327e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed3f6a4-3f2f-45ab-bca6-a1ad03ef38ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed3f6a4-3f2f-45ab-bca6-a1ad03ef38ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4991ef87-8aa9-49f0-b851-fdd5bd88027b', 'volume_name': 'volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dd5852-ce43-42e8-b602-c380b7ed5ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dd5852-ce43-42e8-b602-c380b7ed5ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c055be-2b03-4e02-a684-4a12e2303d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:40 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b', 'volume_size': 1} Jul 23 10:32:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:44 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9" returned: 0 in 4.500s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a43983e-8c00-43b4-9f3e-f1f5dc74f1d6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:44 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 Jul 23 10:32:44 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:44 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9" returned: 0 in 0.534s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:32:44 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Converted 1024.00 MB image at 227.51 MB/s Jul 23 10:32:44 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9 is being set with open permissions: ugo+rw Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:44 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9 Jul 23 10:32:44 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:44 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-594a1de7-240e-430d-b827-bcee640f83f9" released by "_copy_volume_from_snapshot" :: held 6.168s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=106,cinder:UPDATE=156,cinder:DELETE=10,cinder:INSERT=32 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-quobyte-f1bc8a15-4c03-430f-a890-dea1d33b86a8" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-f1bc8a15-4c03-430f-a890-dea1d33b86a8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Deleting offline snapshot f1bc8a15-4c03-430f-a890-dea1d33b86a8 of volume a0310361-4822-429f-9db4-3f141ea0cac9 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] snapshot_file for this snap is: volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c224688d-8cfb-4ffd-89e9-99fb5965a4d7]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:45 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 Jul 23 10:32:45 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:45 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8" returned: 0 in 0.385s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0310361-4822-429f-9db4-3f141ea0cac9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:32:45 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d73c1b-477d-4237-a6fb-52ce76058b97]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:45 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 Jul 23 10:32:45 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:45 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9" returned: 0 in 0.352s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:45 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 Jul 23 10:32:45 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:46 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8" returned: 0 in 0.341s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:46 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8 Jul 23 10:32:46 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:46 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9.f1bc8a15-4c03-430f-a890-dea1d33b86a8" returned: 0 in 0.269s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:46 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:46 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-f1bc8a15-4c03-430f-a890-dea1d33b86a8" released by "_delete_snapshot" :: held 1.435s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=137,cinder:SELECT=115,cinder:INSERT=34,cinder:DELETE=9 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.857s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.726s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1378200083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f757ec6dadf046b2988b5a6b35b0d672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:37Z,use_quota=True,user_id='f992354374db4cdf852ce9d34e257436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Creating volume 8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:46 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bec8dd0-af6a-41c1-b727-8279eeef89db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594a1de7-240e-430d-b827-bcee640f83f9', 'volume_size': 1, 'source_volid': 'a0310361-4822-429f-9db4-3f141ea0cac9', 'source_volstatus': 'available'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:46 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e 1073741824 Jul 23 10:32:46 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccb1e19-f87e-4c71-bc02-c1a439f27a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:46 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Volume volume-594a1de7-240e-430d-b827-bcee640f83f9 (594a1de7-240e-430d-b827-bcee640f83f9): created successfully Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccb1e19-f87e-4c71-bc02-c1a439f27a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (80c7416d-eb22-4655-b5b8-416132c7076c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:46 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0db0502b-c743-4fc0-a8af-9276c683178f tempest-VolumesGetTest-532753094 None] Created volume successfully. Jul 23 10:32:46 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:32:46 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e 1073741824" returned: 0 in 0.430s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:46 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e Jul 23 10:32:46 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:47 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.407s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-166301152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4991ef87-8aa9-49f0-b851-fdd5bd88027b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='333c6943fb3841358863912b2d6b82f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:40Z,use_quota=True,user_id='469451c282ab4dbb9f497d36b24655da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Creating volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:47 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380cfa7a-eae5-42d6-864c-6ed9ee686634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:47 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b 1073741824 Jul 23 10:32:47 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b0d70e-a8ff-4683-acfc-af4ad3e2bf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:47 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Volume volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e (8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e): created successfully Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b0d70e-a8ff-4683-acfc-af4ad3e2bf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Flow 'volume_create_manager' (a269fc04-49df-4599-9168-b48392961056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:47 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7bfefd1b-a40a-4688-9463-a46638ba69e9 tempest-SnapshotDependencyTests-263768017 None] Created volume successfully. Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:47 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b 1073741824" returned: 0 in 0.521s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:47 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b Jul 23 10:32:47 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:47 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b" returned: 0 in 0.264s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.338s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c055be-2b03-4e02-a684-4a12e2303d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40695d4-eb16-40b7-a2a0-a34c51da7905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] Creating offline snapshot 9acd2580-eb2f-4b02-bc4b-44e389345a49 of volume 8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:32:47 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Volume volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b (4991ef87-8aa9-49f0-b851-fdd5bd88027b): created successfully Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40695d4-eb16-40b7-a2a0-a34c51da7905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Flow 'volume_create_manager' (0319724a-3aa0-4440-a5b9-21b4636bd0e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:47 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d8e166-d539-404d-a537-9bafc70543df]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:48 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-cb3c285f-65ba-47cf-9a27-464b7353d27a tempest-SnapshotsActionsTest-934495374 None] Created volume successfully. Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (74a047e7-087f-47d0-9b43-7018b50b4581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d9ff68-f615-4aa3-83f0-b3dec4ae0113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:48 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e Jul 23 10:32:48 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d9ff68-f615-4aa3-83f0-b3dec4ae0113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-149771342',display_name='tempest-VolumesGetTest-Volume-956072218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576a84c4-0af7-44a8-bad3-c30f5e05011f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:48Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ad63fa-99c2-4b3f-8d07-63fd65d38e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ad63fa-99c2-4b3f-8d07-63fd65d38e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d98a80-96b5-45d8-b3ec-9e9f50b2d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d98a80-96b5-45d8-b3ec-9e9f50b2d06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576a84c4-0af7-44a8-bad3-c30f5e05011f', 'volume_name': 'volume-576a84c4-0af7-44a8-bad3-c30f5e05011f', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8056b944-b7ed-4ee6-bf98-68efcfe0a451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8056b944-b7ed-4ee6-bf98-68efcfe0a451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45c74c0-7611-44dc-8a38-b8e71787f8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:48 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Volume 576a84c4-0af7-44a8-bad3-c30f5e05011f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576a84c4-0af7-44a8-bad3-c30f5e05011f', 'volume_size': 1} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:48 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" returned: 0 in 0.413s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:48 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 1G Jul 23 10:32:48 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:48 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 1G" returned: 0 in 0.411s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:48 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 Jul 23 10:32:48 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:49 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49" returned: 0 in 0.288s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:49 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 is being set with open permissions: ugo+rw Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:49 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 Jul 23 10:32:49 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:49 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:49 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.info Jul 23 10:32:49 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:49 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.info" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:49 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.info is being set with open permissions: ugo+rw Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:49 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.info Jul 23 10:32:49 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:49 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.info" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.748s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-149771342',display_name='tempest-VolumesGetTest-Volume-956072218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576a84c4-0af7-44a8-bad3-c30f5e05011f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:48Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Creating volume 576a84c4-0af7-44a8-bad3-c30f5e05011f {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:49 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:32:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:49 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f 1073741824 Jul 23 10:32:49 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:49 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-202c7d6f-1b8b-4702-8f81-820e8775d5dd tempest-SnapshotDependencyTests-263768017 None] Create snapshot completed successfully Jul 23 10:32:50 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f 1073741824" returned: 0 in 0.424s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:50 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f Jul 23 10:32:50 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:50 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.190s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] Creating offline snapshot f86cfc3c-ed73-4907-8834-e8c90496c9e8 of volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45c74c0-7611-44dc-8a38-b8e71787f8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576a84c4-0af7-44a8-bad3-c30f5e05011f', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50764e4-9427-4950-9860-7d5125a73112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be57d5c-ff00-46a9-ad2b-c62cdeb61fcc]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:50 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Volume volume-576a84c4-0af7-44a8-bad3-c30f5e05011f (576a84c4-0af7-44a8-bad3-c30f5e05011f): created successfully Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50764e4-9427-4950-9860-7d5125a73112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (74a047e7-087f-47d0-9b43-7018b50b4581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:50 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1216f3a6-8b63-4944-9999-65616360a3b0 tempest-VolumesGetTest-532753094 None] Created volume successfully. Jul 23 10:32:50 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b Jul 23 10:32:50 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:51 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b" returned: 0 in 0.368s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:51 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 1G Jul 23 10:32:51 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-576a84c4-0af7-44a8-bad3-c30f5e05011f-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Lock "cinder-576a84c4-0af7-44a8-bad3-c30f5e05011f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Flow 'volume_create_manager' (e25a3478-75ae-4690-8524-426b0c6db3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484b5359-258a-4055-863b-3e8c93437556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484b5359-258a-4055-863b-3e8c93437556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef07b77d-4824-467c-86c9-057709cb80ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f757ec6dadf046b2988b5a6b35b0d672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9acd2580-eb2f-4b02-bc4b-44e389345a49,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:51Z,use_quota=True,user_id='f992354374db4cdf852ce9d34e257436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53e2393-f90a-4828-b510-8c8770831934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53e2393-f90a-4828-b510-8c8770831934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f4a9fd-4acc-49ca-8e66-d263a0badcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f4a9fd-4acc-49ca-8e66-d263a0badcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ef07b77d-4824-467c-86c9-057709cb80ad', 'volume_name': 'volume-ef07b77d-4824-467c-86c9-057709cb80ad', 'volume_size': 1, 'snapshot_id': '9acd2580-eb2f-4b02-bc4b-44e389345a49'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9f67d9-0578-4e19-a65a-01d4e51c2dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9f67d9-0578-4e19-a65a-01d4e51c2dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b4fe22-273c-4a54-be0a-dcab7cd0e940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:51 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Volume ef07b77d-4824-467c-86c9-057709cb80ad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ef07b77d-4824-467c-86c9-057709cb80ad', 'volume_size': 1, 'snapshot_id': '9acd2580-eb2f-4b02-bc4b-44e389345a49'} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-quobyte-576a84c4-0af7-44a8-bad3-c30f5e05011f" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-576a84c4-0af7-44a8-bad3-c30f5e05011f" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[db209ebe-1606-479f-8a4c-12eba2122493]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:51 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 1G" returned: 0 in 0.513s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:51 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:32:51 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:51 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f Jul 23 10:32:51 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:51 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.283s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:51 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 is being set with open permissions: ugo+rw Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:51 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:32:51 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:51 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f" returned: 0 in 0.366s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:51 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f Jul 23 10:32:51 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:52 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.257s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:52 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-576a84c4-0af7-44a8-bad3-c30f5e05011f" returned: 0 in 0.249s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:52 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.info Jul 23 10:32:52 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-576a84c4-0af7-44a8-bad3-c30f5e05011f" released by "delete_volume" :: held 0.658s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Created reservations ['02d82ea2-3719-4ec3-9ef3-1d1d126a550e', '8b2dc193-6793-4c8e-bd39-8afd7b19524b', 'bf9c93e7-6416-4b33-9864-b4ea558ca5a5', '96523f20-b726-4223-b501-a1c2f67ccbb1'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:52 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:52 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:52 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.info" returned: 0 in 0.280s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:52 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.info is being set with open permissions: ugo+rw Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:52 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.info Jul 23 10:32:52 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:52 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.276s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:52 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Deleted volume successfully. Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-594a1de7-240e-430d-b827-bcee640f83f9-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Lock "cinder-594a1de7-240e-430d-b827-bcee640f83f9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b886ae4c-0ef4-4838-8dfe-19b63da750fe tempest-VolumesGetTest-532753094 None] Lock "cinder-576a84c4-0af7-44a8-bad3-c30f5e05011f-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-quobyte-594a1de7-240e-430d-b827-bcee640f83f9" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-594a1de7-240e-430d-b827-bcee640f83f9" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:52 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.info" returned: 0 in 0.307s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe8793e-106f-424b-a16d-10eee51c3b80]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.234s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "cinder-quobyte-9acd2580-eb2f-4b02-bc4b-44e389345a49-ef07b77d-4824-467c-86c9-057709cb80ad" by "_create_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-9acd2580-eb2f-4b02-bc4b-44e389345a49-ef07b77d-4824-467c-86c9-057709cb80ad" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Creating volume ef07b77d-4824-467c-86c9-057709cb80ad from snapshot 9acd2580-eb2f-4b02-bc4b-44e389345a49 {{(pid=88371) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "cinder-quobyte-ef07b77d-4824-467c-86c9-057709cb80ad" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-ef07b77d-4824-467c-86c9-057709cb80ad" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] snapshot: 9acd2580-eb2f-4b02-bc4b-44e389345a49, volume: ef07b77d-4824-467c-86c9-057709cb80ad, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cedf50-b62e-4547-8aa8-197e1ba16063]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:52 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9 Jul 23 10:32:52 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:52 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7d215c9b-05a0-4253-9cb6-a38730418750 tempest-SnapshotsActionsTest-934495374 None] Create snapshot completed successfully Jul 23 10:32:52 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 Jul 23 10:32:52 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:53 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9" returned: 0 in 0.389s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:53 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9 Jul 23 10:32:53 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:53 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49" returned: 0 in 0.366s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bd8703-4f2c-4ab5-a8c6-fcf36a94cd0c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:53 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e Jul 23 10:32:53 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:53 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-594a1de7-240e-430d-b827-bcee640f83f9" returned: 0 in 0.262s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-594a1de7-240e-430d-b827-bcee640f83f9" released by "delete_volume" :: held 0.710s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:53 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" returned: 0 in 0.390s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:53 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad Jul 23 10:32:53 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:53 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Created reservations ['a42a09ff-5b2d-4041-bb40-9f37142b06f7', '4f67f981-4399-4012-8124-4ec674cb85e3', 'a57647aa-be93-48af-8868-8973c181f717', 'd3b86cac-8a26-4f24-9746-ad1f64a71ced'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:54 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:54 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:55 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 1.042s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:55 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Deleted volume successfully. Jul 23 10:32:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-df5bf86f-01a2-4a9b-a5a7-753926643aa0 tempest-VolumesGetTest-532753094 None] Lock "cinder-594a1de7-240e-430d-b827-bcee640f83f9-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-a0310361-4822-429f-9db4-3f141ea0cac9-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Lock "cinder-a0310361-4822-429f-9db4-3f141ea0cac9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-quobyte-a0310361-4822-429f-9db4-3f141ea0cac9" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:32:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-a0310361-4822-429f-9db4-3f141ea0cac9" acquired by "delete_volume" :: waited 0.067s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:32:56 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[0309a0bb-cf0b-4833-b6d7-dd4c20abc47f]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:56 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 Jul 23 10:32:56 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:56 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9" returned: 0 in 0.615s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:56 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9 Jul 23 10:32:56 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:57 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a0310361-4822-429f-9db4-3f141ea0cac9" returned: 0 in 0.550s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-a0310361-4822-429f-9db4-3f141ea0cac9" released by "delete_volume" :: held 1.336s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:57 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Created reservations ['868bfd30-031e-45a9-b7b7-076df599cc16', 'fc64e023-9874-43c1-905c-3a23c543ee31', '209e5fdb-670f-4ab4-8d23-e25971925ae4', '6201130a-f049-4f29-87ea-c3fc27e267d5'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:32:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:32:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:32:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:32:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:58 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:32:58 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:58 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad" returned: 0 in 4.777s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:58 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:58 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e68408-85ec-42d0-baf0-06255b669f53]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.444s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:58 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:32:58 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Deleted volume successfully. Jul 23 10:32:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-faf9af7d-891d-4d35-bf3d-7fb9e36f16d2 tempest-VolumesGetTest-532753094 None] Lock "cinder-a0310361-4822-429f-9db4-3f141ea0cac9-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:58 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e Jul 23 10:32:58 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:59 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" returned: 0 in 0.568s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:32:59 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Converted 1024.00 MB image at 214.06 MB/s Jul 23 10:32:59 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad is being set with open permissions: ugo+rw Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:59 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad Jul 23 10:32:59 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (626d23a1-3e62-4f9f-9bb8-2c5c91c87824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966a2174-82be-4eb6-b0d4-a8af04036594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966a2174-82be-4eb6-b0d4-a8af04036594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1524564176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d7b024-db74-4896-90cf-8df2c34aa8d8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:59Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41907a09-75ea-4de1-a91e-df0e48a25502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41907a09-75ea-4de1-a91e-df0e48a25502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cf8c12-9191-42c7-882f-883724f2e944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.image.glance [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Creating Keystone auth plugin from conf {{(pid=88371) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 10:32:59 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad" returned: 0 in 0.264s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-ef07b77d-4824-467c-86c9-057709cb80ad" released by "_copy_volume_from_snapshot" :: held 6.470s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-9acd2580-eb2f-4b02-bc4b-44e389345a49-ef07b77d-4824-467c-86c9-057709cb80ad" released by "_create_volume_from_snapshot" :: held 6.499s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.541s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.436s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] Creating offline snapshot fe03e4fb-689d-4f72-b2a3-b018ecee0d53 of volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eb46bb-a0f3-41bf-bab7-537156a4cd9f]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b4fe22-273c-4a54-be0a-dcab7cd0e940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef07b77d-4824-467c-86c9-057709cb80ad', 'volume_size': 1, 'snapshot_id': '9acd2580-eb2f-4b02-bc4b-44e389345a49'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ee00e7-3bad-4234-a253-c1950e5d205d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Volume volume-ef07b77d-4824-467c-86c9-057709cb80ad (ef07b77d-4824-467c-86c9-057709cb80ad): created successfully Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ee00e7-3bad-4234-a253-c1950e5d205d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Flow 'volume_create_manager' (e25a3478-75ae-4690-8524-426b0c6db3fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:32:59 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:32:59 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-186fe6fc-fb98-41ef-a146-a13c86f0b615 tempest-SnapshotDependencyTests-263768017 None] Created volume successfully. Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cf8c12-9191-42c7-882f-883724f2e944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0d7b024-db74-4896-90cf-8df2c34aa8d8', 'volume_name': 'volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e51db07-8d83-4d87-a4d1-7c71ec667484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e51db07-8d83-4d87-a4d1-7c71ec667484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e62e1c4-3910-4967-b0fc-1455c9c0c446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:32:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Volume d0d7b024-db74-4896-90cf-8df2c34aa8d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Trying to clone d0d7b024-db74-4896-90cf-8df2c34aa8d8 from image c7e93a9b-febb-49a8-91b3-5378e004c880 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]). {{(pid=88371) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 10:32:59 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.378s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:32:59 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 1G Jul 23 10:32:59 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 10:32:59 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Image download 20.69 MB at 20.69 MB/s Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da237e8-1b2a-48e8-baff-e929bec624ce]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:32:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:00 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD Jul 23 10:33:00 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:00 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 1G" returned: 0 in 0.455s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:00 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 Jul 23 10:33:00 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:00 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Temporary image c7e93a9b-febb-49a8-91b3-5378e004c880 is fetched for user 9900fc1a30c044f1bcff2e9a2441e2f5. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a053a7cd-ada0-4869-94f9-27afd54e8152]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "cinder-9acd2580-eb2f-4b02-bc4b-44e389345a49-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-9acd2580-eb2f-4b02-bc4b-44e389345a49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "cinder-quobyte-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "cinder-quobyte-9acd2580-eb2f-4b02-bc4b-44e389345a49" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-9acd2580-eb2f-4b02-bc4b-44e389345a49" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Deleting offline snapshot 9acd2580-eb2f-4b02-bc4b-44e389345a49 of volume 8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] snapshot_file for this snap is: volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[926d61aa-f146-4a6f-b0c8-66f4804a04ca]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:00 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD Jul 23 10:33:00 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:00 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53" returned: 0 in 0.324s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:00 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 is being set with open permissions: ugo+rw Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:00 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 Jul 23 10:33:00 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:00 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 Jul 23 10:33:00 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:00 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:00 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53" returned: 0 in 0.254s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.517s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1524564176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d7b024-db74-4896-90cf-8df2c34aa8d8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:32:59Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Creating volume d0d7b024-db74-4896-90cf-8df2c34aa8d8 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:00 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:33:00 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:00 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 1073741824 Jul 23 10:33:00 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b093a-b533-4c16-822e-5ddd028aa831]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a958fc66-6598-4855-a57e-393ac04aa9ff tempest-SnapshotsActionsTest-934495374 None] Create snapshot completed successfully Jul 23 10:33:01 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e Jul 23 10:33:01 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:01 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" returned: 0 in 0.380s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:01 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 Jul 23 10:33:01 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:01 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 1073741824" returned: 0 in 0.490s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:01 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 Jul 23 10:33:01 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:01 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:01 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49" returned: 0 in 0.340s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8" returned: 0 in 0.269s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:01 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49 Jul 23 10:33:01 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Attempting download of c7e93a9b-febb-49a8-91b3-5378e004c880 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}])) to volume d0d7b024-db74-4896-90cf-8df2c34aa8d8. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa723e3-8d8a-4f99-9f52-25edaa6777b6]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_6ih_cup1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:01 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_6ih_cup1 Jul 23 10:33:01 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:01 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e.9acd2580-eb2f-4b02-bc4b-44e389345a49" returned: 0 in 0.256s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-9acd2580-eb2f-4b02-bc4b-44e389345a49" released by "_delete_snapshot" :: held 1.493s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" released by "delete_snapshot" :: held 1.517s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Created reservations ['e13e128f-1bd5-4faf-80fe-56c44db7d9a9', 'afa25d62-362a-4603-a800-71f3412b4101', '485ace95-aec9-4c87-919e-9c7549f56115', '85a8972b-a4dc-4d68-badd-e96f7855bef1'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:02 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_6ih_cup1" returned: 0 in 0.344s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_6ih_cup1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-fe03e4fb-689d-4f72-b2a3-b018ecee0d53-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-fe03e4fb-689d-4f72-b2a3-b018ecee0d53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:02 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Delete snapshot completed successfully. Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8624ba77-fc2a-4964-b231-b1007a179b17 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-9acd2580-eb2f-4b02-bc4b-44e389345a49-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-quobyte-fe03e4fb-689d-4f72-b2a3-b018ecee0d53" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-fe03e4fb-689d-4f72-b2a3-b018ecee0d53" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Deleting offline snapshot fe03e4fb-689d-4f72-b2a3-b018ecee0d53 of volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:33:02 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_6ih_cup1 Jul 23 10:33:02 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] snapshot_file for this snap is: volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3814b5-1f3d-4bb0-8c24-6c55b9ea96d6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:02 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 Jul 23 10:33:02 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:02 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_6ih_cup1" returned: 1 in 0.353s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_6ih_cup1' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e566e-0113-4aed-a0eb-f4e222be3a04]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "cinder-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:02 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD Jul 23 10:33:02 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:02 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53" returned: 0 in 0.402s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "cinder-quobyte-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb453a10-f107-4e63-98ad-7b10ba3e74ea]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" acquired by "delete_volume" :: waited 0.029s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e67275-2bd4-4780-9e27-591c8033fd57]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:02 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:33:02 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:02 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] c7e93a9b-febb-49a8-91b3-5378e004c880 was qcow2, converting to qcow2 {{(pid=88371) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 10:33:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:02 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e Jul 23 10:33:02 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 Jul 23 10:33:02 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:02 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:03 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.363s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:03 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 Jul 23 10:33:03 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:03 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" returned: 0 in 0.380s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:03 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e Jul 23 10:33:03 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:03 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" returned: 0 in 0.284s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e" released by "delete_volume" :: held 0.729s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Created reservations ['318dafa8-851d-4855-bfdf-9f7b2f95525e', '052d0af7-8eff-4e20-8cb2-45436882716c', 'ecbfd6ee-c43a-466e-a754-cf090751aaae', '08397676-21e5-45a7-a780-2d2b6d3d257b'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:03 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53" returned: 0 in 0.451s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:03 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53 Jul 23 10:33:03 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:03 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:33:03 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "cinder-ef07b77d-4824-467c-86c9-057709cb80ad-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-ef07b77d-4824-467c-86c9-057709cb80ad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:03 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.fe03e4fb-689d-4f72-b2a3-b018ecee0d53" returned: 0 in 0.329s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-fe03e4fb-689d-4f72-b2a3-b018ecee0d53" released by "_delete_snapshot" :: held 1.682s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" released by "delete_snapshot" :: held 1.719s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "cinder-quobyte-ef07b77d-4824-467c-86c9-057709cb80ad" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-ef07b77d-4824-467c-86c9-057709cb80ad" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[894a3f97-a0af-4a9a-bbdf-fd540f5c6d8b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:03 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Created reservations ['4e11a71c-4fe9-4f5a-8669-bc236a309278', '4b9587bf-dbea-4ba7-90dc-90198d3bc00c', '2f2e47f9-b0fc-4740-b4a3-a3aaaeb15ba6', 'cf7ce5b9-0f30-4b17-9bee-2b6de864ec62'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:04 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.390s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:33:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Delete snapshot completed successfully. Jul 23 10:33:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Deleted volume successfully. Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-661de68a-6bb4-44d4-9934-ff17e0ae4b98 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-fe03e4fb-689d-4f72-b2a3-b018ecee0d53-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:04 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad Jul 23 10:33:04 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d26be846-a14a-40ea-bfe4-ef437025a4d8 tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-8460d2dd-9323-42f8-9a8c-6c41f5d2ea0e-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:04 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad" returned: 0 in 0.451s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:04 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad Jul 23 10:33:04 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] Creating offline snapshot e3bc6b7c-1911-43c1-9223-75f4fecedd5e of volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedba8ec-08e3-40f9-b503-f3f77f8f4a3c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:04 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ef07b77d-4824-467c-86c9-057709cb80ad" returned: 0 in 0.322s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-quobyte-ef07b77d-4824-467c-86c9-057709cb80ad" released by "delete_volume" :: held 0.819s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:04 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8" returned: 0 in 1.964s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_tyho_3mcdevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:33:04 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Converted 112.00 MB image at 57.00 MB/s Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:04 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 1G Jul 23 10:33:04 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Created reservations ['cb073a91-8053-43f9-bd81-410627620390', 'fdc24c38-3c99-4dc6-be93-bf4b759791a2', '4f6f5842-ea82-4dbf-945b-28a05d6a95b1', '0d3e3032-43cf-4cb9-ac99-4e9780c4db09'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:04 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:33:04 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:04 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:33:04 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:05 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.411s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:05 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e 1G Jul 23 10:33:05 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:05 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 1G" returned: 0 in 0.409s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Downloaded image c7e93a9b-febb-49a8-91b3-5378e004c880 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}])) to volume d0d7b024-db74-4896-90cf-8df2c34aa8d8 successfully. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Temporary image c7e93a9b-febb-49a8-91b3-5378e004c880 for user 9900fc1a30c044f1bcff2e9a2441e2f5 is deleted. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Marking volume d0d7b024-db74-4896-90cf-8df2c34aa8d8 as bootable. {{(pid=88371) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 10:33:05 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.306s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Copying metadata from image c7e93a9b-febb-49a8-91b3-5378e004c880 to d0d7b024-db74-4896-90cf-8df2c34aa8d8. {{(pid=88371) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Creating volume glance metadata for volume d0d7b024-db74-4896-90cf-8df2c34aa8d8 backed by image c7e93a9b-febb-49a8-91b3-5378e004c880 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88371) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 10:33:05 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Deleted volume successfully. Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a4f15899-820d-4912-b6f5-a2a28414428f tempest-SnapshotDependencyTests-263768017 None] Lock "cinder-ef07b77d-4824-467c-86c9-057709cb80ad-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e62e1c4-3910-4967-b0fc-1455c9c0c446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a285b70-2f2d-4a3d-8ebb-367b095546fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:05 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Volume volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 (d0d7b024-db74-4896-90cf-8df2c34aa8d8): created successfully Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a285b70-2f2d-4a3d-8ebb-367b095546fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (626d23a1-3e62-4f9f-9bb8-2c5c91c87824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:05 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1aabf01a-9866-4396-8d7b-d514d9d49266 tempest-VolumesGetTest-532753094 None] Created volume successfully. Jul 23 10:33:05 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e 1G" returned: 0 in 0.514s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:05 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e Jul 23 10:33:05 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:05 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e" returned: 0 in 0.335s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:05 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e is being set with open permissions: ugo+rw Jul 23 10:33:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:05 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e Jul 23 10:33:05 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:06 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e" returned: 0 in 0.285s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.666s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (2f88c51d-ad0a-4c99-b867-117154a08a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff74553-3e27-4411-ae0b-a9de48f10d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff74553-3e27-4411-ae0b-a9de48f10d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1152421406',display_name='tempest-VolumesGetTest-Volume-777591169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b63b9b-347a-4702-b661-d3d721751930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:06Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cea2a3-807a-494f-bbcf-4f4df15f331e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cea2a3-807a-494f-bbcf-4f4df15f331e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2037dc7c-1e2c-4970-9337-7d666d01175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2037dc7c-1e2c-4970-9337-7d666d01175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b63b9b-347a-4702-b661-d3d721751930', 'volume_name': 'volume-87b63b9b-347a-4702-b661-d3d721751930', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469bad05-5af1-4184-b9b9-439a06559f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469bad05-5af1-4184-b9b9-439a06559f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813a2c35-0ecd-48a4-b253-f24a336a987e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:06 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Volume 87b63b9b-347a-4702-b661-d3d721751930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b63b9b-347a-4702-b661-d3d721751930', 'volume_size': 1} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1152421406',display_name='tempest-VolumesGetTest-Volume-777591169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b63b9b-347a-4702-b661-d3d721751930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171c5f9033564ca5ad5debf2c97af7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:06Z,use_quota=True,user_id='9900fc1a30c044f1bcff2e9a2441e2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Creating volume 87b63b9b-347a-4702-b661-d3d721751930 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:33:06 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:06 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-40ad1bf7-a2aa-493d-b476-76b6a55ad1c5 tempest-SnapshotsActionsTest-934495374 None] Create snapshot completed successfully Jul 23 10:33:06 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930 1073741824 Jul 23 10:33:06 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-e3bc6b7c-1911-43c1-9223-75f4fecedd5e-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-e3bc6b7c-1911-43c1-9223-75f4fecedd5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:06 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930 1073741824" returned: 0 in 0.536s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-quobyte-e3bc6b7c-1911-43c1-9223-75f4fecedd5e" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-e3bc6b7c-1911-43c1-9223-75f4fecedd5e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Deleting offline snapshot e3bc6b7c-1911-43c1-9223-75f4fecedd5e of volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] snapshot_file for this snap is: volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:33:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa589c27-a12b-4535-ae30-8a97a2c10102]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:07 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930 Jul 23 10:33:07 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:07 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e Jul 23 10:33:07 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:07 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813a2c35-0ecd-48a4-b253-f24a336a987e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b63b9b-347a-4702-b661-d3d721751930', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681861d5-a065-408c-a72f-a5005f643470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:07 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Volume volume-87b63b9b-347a-4702-b661-d3d721751930 (87b63b9b-347a-4702-b661-d3d721751930): created successfully Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681861d5-a065-408c-a72f-a5005f643470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Flow 'volume_create_manager' (2f88c51d-ad0a-4c99-b867-117154a08a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-43f05cfc-cf77-457f-a380-bd51fdff9688 tempest-VolumesGetTest-532753094 None] Created volume successfully. Jul 23 10:33:07 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e" returned: 0 in 0.385s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6caeed3-2e5e-4320-bcca-8b4a9ebd8cad]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:07 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:33:07 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:07 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.418s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:07 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e Jul 23 10:33:07 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:08 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e" returned: 0 in 0.428s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:08 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e Jul 23 10:33:08 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-87b63b9b-347a-4702-b661-d3d721751930-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Lock "cinder-87b63b9b-347a-4702-b661-d3d721751930-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:08 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.e3bc6b7c-1911-43c1-9223-75f4fecedd5e" returned: 0 in 0.308s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-quobyte-87b63b9b-347a-4702-b661-d3d721751930" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-e3bc6b7c-1911-43c1-9223-75f4fecedd5e" released by "_delete_snapshot" :: held 1.650s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" released by "delete_snapshot" :: held 1.678s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-87b63b9b-347a-4702-b661-d3d721751930" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aa1cf1-65f0-4e90-b266-1296ffd47bdf]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Created reservations ['2536e6da-40fa-412e-844f-1b289deae188', '8b984704-643c-4d52-844f-49873c4353f6', '6ef45b15-ac21-48e1-ae65-5ccffe5680c0', '50f7176f-841d-466e-8ba1-aaa1b0a761e5'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:08 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Delete snapshot completed successfully. Jul 23 10:33:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c46bd174-5eb4-46d0-a065-08a84e4d377a tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-e3bc6b7c-1911-43c1-9223-75f4fecedd5e-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:08 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930 Jul 23 10:33:08 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:09 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930" returned: 0 in 0.460s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:09 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930 Jul 23 10:33:09 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:09 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-87b63b9b-347a-4702-b661-d3d721751930" returned: 0 in 0.289s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-87b63b9b-347a-4702-b661-d3d721751930" released by "delete_volume" :: held 0.791s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] Creating offline snapshot a2b312fe-0f80-4ffb-a513-62d356e2ad58 of volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[7def4e1a-2691-436d-8c16-f8317d469763]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Created reservations ['87aa1d72-94fd-466d-a167-3158edfc0a51', '07026b8b-7301-43ef-a945-4e88f5ab9999', '0bc626ac-c915-41f1-a582-3e2ad66af6a1', '6c8c42b8-a517-4374-b960-aaf8cfe31f49'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:09 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:33:09 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:09 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:33:09 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-d0d7b024-db74-4896-90cf-8df2c34aa8d8-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Lock "cinder-d0d7b024-db74-4896-90cf-8df2c34aa8d8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Acquiring lock "cinder-quobyte-d0d7b024-db74-4896-90cf-8df2c34aa8d8" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-d0d7b024-db74-4896-90cf-8df2c34aa8d8" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e836c10-2de8-4c53-9e7d-572edcaae251]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:10 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.337s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:33:10 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Deleted volume successfully. Jul 23 10:33:10 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.552s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ac9524b8-2044-4ced-b241-93923f7b7581 tempest-VolumesGetTest-532753094 None] Lock "cinder-87b63b9b-347a-4702-b661-d3d721751930-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:10 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 1G Jul 23 10:33:10 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:10 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 Jul 23 10:33:10 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:10 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8" returned: 0 in 0.407s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:10 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8 Jul 23 10:33:10 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:10 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 1G" returned: 0 in 0.497s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:10 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 Jul 23 10:33:10 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:10 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d0d7b024-db74-4896-90cf-8df2c34aa8d8" returned: 0 in 0.309s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Lock "cinder-quobyte-d0d7b024-db74-4896-90cf-8df2c34aa8d8" released by "delete_volume" :: held 0.763s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Created reservations ['f29b0268-f3ba-42da-87c3-2a9665a4ad20', '69614444-daf6-48b8-8470-36ef0ab703b9', 'f23a96aa-b74b-4cbc-b478-c509a28fe8b3', '4d03d29e-5608-46ab-bd84-a78b4eb687ad'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:10 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:33:10 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:10 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58" returned: 0 in 0.325s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:10 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 is being set with open permissions: ugo+rw Jul 23 10:33:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:10 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 Jul 23 10:33:10 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:11 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.304s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:33:11 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Deleted volume successfully. Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2a02771d-46f3-4032-9c38-4c5da560ece6 tempest-VolumesGetTest-532753094 None] Lock "cinder-d0d7b024-db74-4896-90cf-8df2c34aa8d8-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:11 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58" returned: 0 in 0.302s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.793s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:11 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9a164b83-392f-4d8b-b3c6-65e7e142198a tempest-SnapshotsActionsTest-934495374 None] Create snapshot completed successfully Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-a2b312fe-0f80-4ffb-a513-62d356e2ad58-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-a2b312fe-0f80-4ffb-a513-62d356e2ad58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-quobyte-a2b312fe-0f80-4ffb-a513-62d356e2ad58" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-a2b312fe-0f80-4ffb-a513-62d356e2ad58" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Deleting offline snapshot a2b312fe-0f80-4ffb-a513-62d356e2ad58 of volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] snapshot_file for this snap is: volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ab8b17-abc4-4b5e-a689-d9be8e37aab1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:11 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 Jul 23 10:33:11 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:12 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58" returned: 0 in 0.496s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:12 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d32ab2b-3f8d-48c6-a880-dc71c4bacb2d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:12 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:33:12 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:12 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.400s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:12 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 Jul 23 10:33:12 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:13 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58" returned: 0 in 0.426s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:13 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58 Jul 23 10:33:13 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:13 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.a2b312fe-0f80-4ffb-a513-62d356e2ad58" returned: 0 in 0.280s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-a2b312fe-0f80-4ffb-a513-62d356e2ad58" released by "_delete_snapshot" :: held 1.728s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" released by "delete_snapshot" :: held 1.753s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:13 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Created reservations ['44558fa7-821b-4d47-9524-6581b7b60bdc', 'dfc0b18c-9112-4aa9-9194-7939f5a2925d', 'f077d851-9d36-476f-8d3d-989c16967239', '59a97a13-6260-477d-a9c3-e3c6674d2c58'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:13 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Delete snapshot completed successfully. Jul 23 10:33:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cc40d703-b711-4c73-af5c-c4cc9aa18147 tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-a2b312fe-0f80-4ffb-a513-62d356e2ad58-delete_snapshot" released by "delete_snapshot" :: held 1.969s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] Creating offline snapshot 64ebe910-aed8-4c43-b35d-ad92166325ea of volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:33:14 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[305061dd-f707-431c-b2af-14c7f50c06ec]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:14 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:33:14 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:14 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.456s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:14 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea 1G Jul 23 10:33:14 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:15 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea 1G" returned: 0 in 0.452s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:15 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea Jul 23 10:33:15 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:15 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea" returned: 0 in 0.294s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:15 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea is being set with open permissions: ugo+rw Jul 23 10:33:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:15 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea Jul 23 10:33:15 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:15 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea" returned: 0 in 0.297s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.612s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7092a0a0-a167-44c9-a89a-c2ed96f1fb5f tempest-SnapshotsActionsTest-934495374 None] Create snapshot completed successfully Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-64ebe910-aed8-4c43-b35d-ad92166325ea-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-64ebe910-aed8-4c43-b35d-ad92166325ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Acquiring lock "cinder-quobyte-64ebe910-aed8-4c43-b35d-ad92166325ea" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-64ebe910-aed8-4c43-b35d-ad92166325ea" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Deleting offline snapshot 64ebe910-aed8-4c43-b35d-ad92166325ea of volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] snapshot_file for this snap is: volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a88086-69f5-4061-929b-8ae1c004acc7]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:16 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea Jul 23 10:33:16 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:16 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea" returned: 0 in 0.360s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[885ff14a-e335-40f0-9591-32e996e46dbd]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:16 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:33:16 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Flow 'volume_create_manager' (3cb73892-020f-4537-82b8-c07beb1c7ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f508e10b-11e9-42db-bd51-d9f58221c06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f508e10b-11e9-42db-bd51-d9f58221c06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-755462796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50459cea-8195-4590-a9a4-b9e91e20493a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3c240e56a74e3989ceb3d388f07e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:17Z,use_quota=True,user_id='e2c960df0dd44d2aa5b4c57b778e3703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677d0b73-b24d-4b1b-b6f3-915435c21308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677d0b73-b24d-4b1b-b6f3-915435c21308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761b27da-e180-4c90-a22a-8d5cb11a7d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761b27da-e180-4c90-a22a-8d5cb11a7d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50459cea-8195-4590-a9a4-b9e91e20493a', 'volume_name': 'volume-50459cea-8195-4590-a9a4-b9e91e20493a', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d58ae26-cbf6-43b7-80bf-75e3da496ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d58ae26-cbf6-43b7-80bf-75e3da496ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076370df-a136-4d7a-9abc-51bc09288d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:17 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Volume 50459cea-8195-4590-a9a4-b9e91e20493a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50459cea-8195-4590-a9a4-b9e91e20493a', 'volume_size': 1} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-755462796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50459cea-8195-4590-a9a4-b9e91e20493a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3c240e56a74e3989ceb3d388f07e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:17Z,use_quota=True,user_id='e2c960df0dd44d2aa5b4c57b778e3703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Creating volume 50459cea-8195-4590-a9a4-b9e91e20493a {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:33:17 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:17 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.389s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:17 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a 1073741824 Jul 23 10:33:17 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:17 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea Jul 23 10:33:17 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:17 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea" returned: 0 in 0.372s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:17 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a 1073741824" returned: 0 in 0.413s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:17 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea Jul 23 10:33:17 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:17 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a Jul 23 10:33:17 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:17 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.64ebe910-aed8-4c43-b35d-ad92166325ea" returned: 0 in 0.250s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-64ebe910-aed8-4c43-b35d-ad92166325ea" released by "_delete_snapshot" :: held 1.468s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:17 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a" returned: 0 in 0.235s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" released by "delete_snapshot" :: held 1.497s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076370df-a136-4d7a-9abc-51bc09288d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50459cea-8195-4590-a9a4-b9e91e20493a', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb8b1bb-3b59-4bae-8c4a-25f6436ad139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:17 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Volume volume-50459cea-8195-4590-a9a4-b9e91e20493a (50459cea-8195-4590-a9a4-b9e91e20493a): created successfully Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb8b1bb-3b59-4bae-8c4a-25f6436ad139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Flow 'volume_create_manager' (3cb73892-020f-4537-82b8-c07beb1c7ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1f8aeeea-a23d-405c-9721-20ca3cf4363f tempest-VolumesNegativeTest-1034903260 None] Created volume successfully. Jul 23 10:33:17 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Created reservations ['baa427f6-2c94-41f9-9ac3-8cfa4093cb36', 'c68db840-54ab-4039-85ba-210868c63499', '86f9a7ff-90bf-4fa9-811c-e3c4c6e7b84a', '82fc3fd9-c41c-48e8-9249-5b6c12e6ac00'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:18 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Delete snapshot completed successfully. Jul 23 10:33:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6174e5fd-87cb-4203-bb60-c5618aa13fca tempest-SnapshotsActionsTest-1784272614 None] Lock "cinder-64ebe910-aed8-4c43-b35d-ad92166325ea-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "cinder-f86cfc3c-ed73-4907-8834-e8c90496c9e8-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Lock "cinder-f86cfc3c-ed73-4907-8834-e8c90496c9e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "cinder-quobyte-f86cfc3c-ed73-4907-8834-e8c90496c9e8" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Lock "cinder-quobyte-f86cfc3c-ed73-4907-8834-e8c90496c9e8" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Deleting offline snapshot f86cfc3c-ed73-4907-8834-e8c90496c9e8 of volume 4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] snapshot_file for this snap is: volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3ae1d7-8903-45c2-ad92-ad81285d6699]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:19 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:33:19 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:19 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.388s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcff32e-7585-45ec-80e2-f9136ffd3a17]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:19 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b Jul 23 10:33:19 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:20 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b" returned: 0 in 0.435s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:20 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:33:20 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:20 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:20 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8 Jul 23 10:33:20 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:20 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b.f86cfc3c-ed73-4907-8834-e8c90496c9e8" returned: 0 in 0.292s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Lock "cinder-quobyte-f86cfc3c-ed73-4907-8834-e8c90496c9e8" released by "_delete_snapshot" :: held 1.627s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" released by "delete_snapshot" :: held 1.702s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:20 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Created reservations ['825c22c3-2c43-400f-831c-d08aa337d0d4', '435ea5ec-b813-47bc-99ad-f5075a0ed793', 'a227fe8f-92c3-41c7-958c-40e52911b7d6', '37005f0e-8768-436d-a4df-b4f03b004183'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:20 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Delete snapshot completed successfully. Jul 23 10:33:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6973d298-65e6-43f2-b5d2-141b799aec5a tempest-SnapshotsActionsTest-934495374 None] Lock "cinder-f86cfc3c-ed73-4907-8834-e8c90496c9e8-delete_snapshot" released by "delete_snapshot" :: held 1.852s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:21 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "cinder-4991ef87-8aa9-49f0-b851-fdd5bd88027b-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:21 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Lock "cinder-4991ef87-8aa9-49f0-b851-fdd5bd88027b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:21 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:21 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:21 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b09ea05-461a-42b0-a09e-7e9ec38c88c1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:21 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b Jul 23 10:33:21 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:21 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b" returned: 0 in 0.382s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:21 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b Jul 23 10:33:21 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:22 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4991ef87-8aa9-49f0-b851-fdd5bd88027b" returned: 0 in 0.250s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Lock "cinder-quobyte-4991ef87-8aa9-49f0-b851-fdd5bd88027b" released by "delete_volume" :: held 0.693s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Created reservations ['5f650488-2f00-456e-bbf1-9c412f3523f0', '66184a49-6245-4855-940a-3eab4007908b', '05553d22-947f-4707-86bb-dadaaeb80e24', '1fccf19c-c6f4-4e34-b5eb-595b60eeec78'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:22 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:33:22 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:22 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:33:22 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Deleted volume successfully. Jul 23 10:33:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9a91de34-b4c7-4a7c-9830-cb464b72fd81 tempest-SnapshotsActionsTest-934495374 None] Lock "cinder-4991ef87-8aa9-49f0-b851-fdd5bd88027b-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:32 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=125,cinder:SELECT=115,cinder:DELETE=9,cinder:INSERT=34 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:33:32 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=130,cinder:SELECT=100,cinder:INSERT=44,cinder:DELETE=13 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:33:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Acquiring lock "cinder-50459cea-8195-4590-a9a4-b9e91e20493a-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Lock "cinder-50459cea-8195-4590-a9a4-b9e91e20493a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Acquiring lock "cinder-quobyte-50459cea-8195-4590-a9a4-b9e91e20493a" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Lock "cinder-quobyte-50459cea-8195-4590-a9a4-b9e91e20493a" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:35 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19881ae-3273-4ce0-8b49-5e4177e631fa]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:36 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a Jul 23 10:33:36 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:36 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a" returned: 0 in 0.373s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:36 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a Jul 23 10:33:36 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:36 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50459cea-8195-4590-a9a4-b9e91e20493a" returned: 0 in 0.243s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:36 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Lock "cinder-quobyte-50459cea-8195-4590-a9a4-b9e91e20493a" released by "delete_volume" :: held 0.657s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:36 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Created reservations ['7f502bdc-b8f7-4eed-bd3e-d9f0b5fb47e3', '75c398d2-6490-4067-baf2-0e56c261c488', '89d33910-764e-47b1-bc0e-e5f329106018', '76eb8cdc-a7a5-45fd-bf4b-5cc598f64948'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:36 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:33:36 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:37 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.255s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:37 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:33:37 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Deleted volume successfully. Jul 23 10:33:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c769f171-5f82-4e55-ae71-cedb047e4532 tempest-VolumesNegativeTest-1034903260 None] Lock "cinder-50459cea-8195-4590-a9a4-b9e91e20493a-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Flow 'volume_create_manager' (6df5251f-5f4a-4c09-a908-c96eb3062a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e872f1a-c705-4b08-ace9-b637c364f965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e872f1a-c705-4b08-ace9-b637c364f965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1711901734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee73e7f8-8278-4fd4-8d0c-34d168c8bb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bceeef9ed3ef4e3f92e2a816e8c3f776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:40Z,use_quota=True,user_id='94416b552b904325acccd4f31b34e0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c3cb12-7a03-4318-a4be-6a7fbd8ca94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c3cb12-7a03-4318-a4be-6a7fbd8ca94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4f0913-4cb5-4421-ab6c-6244d75990fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4f0913-4cb5-4421-ab6c-6244d75990fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee73e7f8-8278-4fd4-8d0c-34d168c8bb06', 'volume_name': 'volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06', 'volume_size': 2}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523dcef7-797e-4d2d-ba5b-985caf84dcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523dcef7-797e-4d2d-ba5b-985caf84dcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3995711b-6383-4fc2-ba61-ebc214e3c083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:40 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Volume ee73e7f8-8278-4fd4-8d0c-34d168c8bb06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06', 'volume_size': 2} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1711901734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee73e7f8-8278-4fd4-8d0c-34d168c8bb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bceeef9ed3ef4e3f92e2a816e8c3f776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:40Z,use_quota=True,user_id='94416b552b904325acccd4f31b34e0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Creating volume ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:33:40 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 2147483648 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:40 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 2147483648 Jul 23 10:33:40 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:40 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 2147483648" returned: 0 in 0.535s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:40 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 Jul 23 10:33:40 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:41 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06" returned: 0 in 0.262s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:33:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3995711b-6383-4fc2-ba61-ebc214e3c083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06', 'volume_size': 2}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cea645-837c-4b62-b924-c64a034d406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:41 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Volume volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 (ee73e7f8-8278-4fd4-8d0c-34d168c8bb06): created successfully Jul 23 10:33:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cea645-837c-4b62-b924-c64a034d406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Flow 'volume_create_manager' (6df5251f-5f4a-4c09-a908-c96eb3062a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:41 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e31699d4-525e-436e-8590-09e3a05e4c9e tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Created volume successfully. Jul 23 10:33:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Creating offline snapshot 12bc2863-4141-4281-ab19-96235849a4d2 of volume ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:33:42 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7c525c-a6d9-4d73-9f5a-1eee0c19fc12]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:42 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 Jul 23 10:33:42 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:42 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06" returned: 0 in 0.386s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 2G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:42 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 2G Jul 23 10:33:42 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:43 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 2G" returned: 0 in 0.414s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:43 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 Jul 23 10:33:43 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:43 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2" returned: 0 in 0.309s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:43 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 is being set with open permissions: ugo+rw Jul 23 10:33:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:43 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 Jul 23 10:33:43 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:43 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:43 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.info Jul 23 10:33:43 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:44 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.info" returned: 0 in 0.252s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:44 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.info is being set with open permissions: ugo+rw Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:44 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.info Jul 23 10:33:44 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:44 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.info" returned: 0 in 0.258s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:44 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-01644526-7fef-45a3-8a5f-143af53d1684 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Create snapshot completed successfully Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Acquiring lock "cinder-12bc2863-4141-4281-ab19-96235849a4d2-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "cinder-12bc2863-4141-4281-ab19-96235849a4d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Acquiring lock "cinder-quobyte-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "cinder-quobyte-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Acquiring lock "cinder-quobyte-12bc2863-4141-4281-ab19-96235849a4d2" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "cinder-quobyte-12bc2863-4141-4281-ab19-96235849a4d2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Deleting offline snapshot 12bc2863-4141-4281-ab19-96235849a4d2 of volume ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] snapshot_file for this snap is: volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a3b856-6472-4206-826f-5ff962ccb655]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:44 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 Jul 23 10:33:44 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:45 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2" returned: 0 in 0.439s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:33:45 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbbd90f-7fd0-463b-b8df-ea6de519ed4a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:45 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 Jul 23 10:33:45 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:45 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06" returned: 0 in 0.397s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:45 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 Jul 23 10:33:45 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:45 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2" returned: 0 in 0.370s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:45 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2 Jul 23 10:33:45 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:46 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06.12bc2863-4141-4281-ab19-96235849a4d2" returned: 0 in 0.259s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "cinder-quobyte-12bc2863-4141-4281-ab19-96235849a4d2" released by "_delete_snapshot" :: held 1.589s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "cinder-quobyte-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06" released by "delete_snapshot" :: held 1.616s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:46 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:33:46 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Created reservations ['6a358a47-8279-4571-8c63-1e672ca483f4', 'e114c744-4453-497b-acb1-0aad63be3c7f', 'a122cfeb-2414-4979-87f6-50c6602fc09b', '36448a5b-848d-4584-a22d-610ed1586982'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:46 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Delete snapshot completed successfully. Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9ca7e9d3-22cd-4448-9128-b7cf720f0e0c tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "cinder-12bc2863-4141-4281-ab19-96235849a4d2-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:46 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.281s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Acquiring lock "cinder-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "cinder-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Acquiring lock "cinder-quobyte-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "cinder-quobyte-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8129475-07c7-4936-81b1-da9023875778]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:47 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 Jul 23 10:33:47 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:47 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06" returned: 0 in 0.374s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:47 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06 Jul 23 10:33:47 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:47 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06" returned: 0 in 0.268s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "cinder-quobyte-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06" released by "delete_volume" :: held 0.702s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Created reservations ['e2db9e31-3079-4975-b006-1c48424bbced', 'ba64e6f2-f9c7-4ee3-af3b-0ba2110994a2', 'e6210a6b-b40c-411b-ad32-f1303f6061fa', 'fac307da-2f3a-40cd-9b1e-4ed53927aab0'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:47 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:33:47 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:47 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.245s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:33:47 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Deleted volume successfully. Jul 23 10:33:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-81a8119e-cea0-4660-aa9f-36b0fa26f793 tempest-VolumesSnapshotNegativeTestJSON-24406162 None] Lock "cinder-ee73e7f8-8278-4fd4-8d0c-34d168c8bb06-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Flow 'volume_create_manager' (a491661a-cf89-48e3-bf30-eecff1d99b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22909b1-6825-41b9-b574-e0af97b1c9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22909b1-6825-41b9-b574-e0af97b1c9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-466807886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37502663-fa5e-4e4d-9a78-36ba76c5543d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5376e457c8994aa6bff2eb9ce2842d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:48Z,use_quota=True,user_id='89d895721f814b27b2dfdaaef508506b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e33d8e5-4dbb-4c85-8974-e57119e34d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e33d8e5-4dbb-4c85-8974-e57119e34d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12348840-879f-4d25-822b-a7e771f15bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12348840-879f-4d25-822b-a7e771f15bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37502663-fa5e-4e4d-9a78-36ba76c5543d', 'volume_name': 'volume-37502663-fa5e-4e4d-9a78-36ba76c5543d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ba7e13-b254-4d29-8c6b-10f093ef0a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ba7e13-b254-4d29-8c6b-10f093ef0a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebbf4df-50e9-419a-a577-6cbfa50294be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:48 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Volume 37502663-fa5e-4e4d-9a78-36ba76c5543d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37502663-fa5e-4e4d-9a78-36ba76c5543d', 'volume_size': 1} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-466807886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37502663-fa5e-4e4d-9a78-36ba76c5543d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5376e457c8994aa6bff2eb9ce2842d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:48Z,use_quota=True,user_id='89d895721f814b27b2dfdaaef508506b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Creating volume 37502663-fa5e-4e4d-9a78-36ba76c5543d {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:33:48 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:48 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d 1073741824 Jul 23 10:33:48 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:48 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d 1073741824" returned: 0 in 0.464s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:49 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d Jul 23 10:33:49 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:49 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d" returned: 0 in 0.272s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:33:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebbf4df-50e9-419a-a577-6cbfa50294be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37502663-fa5e-4e4d-9a78-36ba76c5543d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13feeb84-7c77-4457-912a-f07e62126e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:49 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Volume volume-37502663-fa5e-4e4d-9a78-36ba76c5543d (37502663-fa5e-4e4d-9a78-36ba76c5543d): created successfully Jul 23 10:33:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13feeb84-7c77-4457-912a-f07e62126e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Flow 'volume_create_manager' (a491661a-cf89-48e3-bf30-eecff1d99b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:49 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-08b56035-b8f9-4431-b809-8b79deef5462 tempest-VolumesListAdminTestJSON-354590759 None] Created volume successfully. Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Flow 'volume_create_manager' (ab5c269f-71e1-4d62-a193-32964e6a50df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83237fcc-c578-4763-b1f8-700d3db89c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83237fcc-c578-4763-b1f8-700d3db89c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-412385453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41e47a2-e984-4a0b-ad5f-bcd461764083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5376e457c8994aa6bff2eb9ce2842d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:50Z,use_quota=True,user_id='89d895721f814b27b2dfdaaef508506b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5c9223-793a-469f-b183-93f74e760bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5c9223-793a-469f-b183-93f74e760bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68cf778-1d1b-402e-b54a-f3803fd2ed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68cf778-1d1b-402e-b54a-f3803fd2ed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41e47a2-e984-4a0b-ad5f-bcd461764083', 'volume_name': 'volume-e41e47a2-e984-4a0b-ad5f-bcd461764083', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74030e4d-c0cb-4f29-94c0-57d9c6bb4571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74030e4d-c0cb-4f29-94c0-57d9c6bb4571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95508ed-a8eb-4a0a-84dc-0fbb16c4840e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:50 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Volume e41e47a2-e984-4a0b-ad5f-bcd461764083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41e47a2-e984-4a0b-ad5f-bcd461764083', 'volume_size': 1} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-412385453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41e47a2-e984-4a0b-ad5f-bcd461764083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5376e457c8994aa6bff2eb9ce2842d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:50Z,use_quota=True,user_id='89d895721f814b27b2dfdaaef508506b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Creating volume e41e47a2-e984-4a0b-ad5f-bcd461764083 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:33:50 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:50 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083 1073741824 Jul 23 10:33:50 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:50 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083 1073741824" returned: 0 in 0.483s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:50 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083 Jul 23 10:33:50 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:50 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95508ed-a8eb-4a0a-84dc-0fbb16c4840e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41e47a2-e984-4a0b-ad5f-bcd461764083', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b1e081-8cbe-4782-ab2c-d94dc71ecf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:50 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Volume volume-e41e47a2-e984-4a0b-ad5f-bcd461764083 (e41e47a2-e984-4a0b-ad5f-bcd461764083): created successfully Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b1e081-8cbe-4782-ab2c-d94dc71ecf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Flow 'volume_create_manager' (ab5c269f-71e1-4d62-a193-32964e6a50df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:50 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6a16c921-88fc-4152-ae83-2ce664309478 tempest-VolumesListAdminTestJSON-354590759 None] Created volume successfully. Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Flow 'volume_create_manager' (0597fff9-82df-4b41-8c7e-d36692925b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb97298-d658-4479-b37a-3153e4b3f68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb97298-d658-4479-b37a-3153e4b3f68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-868298062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5376e457c8994aa6bff2eb9ce2842d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:53Z,use_quota=True,user_id='89d895721f814b27b2dfdaaef508506b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c16903-41f4-4f57-8dc3-1c1692325810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c16903-41f4-4f57-8dc3-1c1692325810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a97bd19-edf3-4f55-b712-fa2fc0348bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a97bd19-edf3-4f55-b712-fa2fc0348bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8', 'volume_name': 'volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e433613-c15c-4b72-aa61-b64d4d6b67f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e433613-c15c-4b72-aa61-b64d4d6b67f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8499858c-3dc9-4c5b-9e1c-9577c67d9c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:52 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Volume 2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8', 'volume_size': 1} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-868298062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5376e457c8994aa6bff2eb9ce2842d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:53Z,use_quota=True,user_id='89d895721f814b27b2dfdaaef508506b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Creating volume 2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:33:52 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:33:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:52 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8 1073741824 Jul 23 10:33:52 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:53 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8 1073741824" returned: 0 in 0.424s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:53 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8 Jul 23 10:33:53 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:53 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8" returned: 0 in 0.266s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:33:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8499858c-3dc9-4c5b-9e1c-9577c67d9c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c08239-4d0b-4694-86b2-332310d984e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:53 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Volume volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8 (2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8): created successfully Jul 23 10:33:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c08239-4d0b-4694-86b2-332310d984e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Flow 'volume_create_manager' (0597fff9-82df-4b41-8c7e-d36692925b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0fce7c4a-f575-4fd4-86b9-fb523961d28f tempest-VolumesListAdminTestJSON-354590759 None] Created volume successfully. Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Flow 'volume_create_manager' (673993a5-dbb7-421c-94a0-a828d84cdea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6230ca46-7429-4e07-a6ae-81e96661b6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6230ca46-7429-4e07-a6ae-81e96661b6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ea4392-6016-473a-96f8-dc59e29bc40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d1ce87264244288c1ecfa42c17808e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:54Z,use_quota=True,user_id='99f755d146244f66b9a325d8ac497212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a162303-1016-4d54-8147-a8d35102b3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a162303-1016-4d54-8147-a8d35102b3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7ad108-66a5-4cb5-9616-d9834117f73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7ad108-66a5-4cb5-9616-d9834117f73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ea4392-6016-473a-96f8-dc59e29bc40e', 'volume_name': 'volume-d9ea4392-6016-473a-96f8-dc59e29bc40e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ff85f4-dd87-4fbb-8890-124bd6fc39e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ff85f4-dd87-4fbb-8890-124bd6fc39e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed5c344-be8a-4044-9365-8246d8cf41a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:54 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Volume d9ea4392-6016-473a-96f8-dc59e29bc40e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ea4392-6016-473a-96f8-dc59e29bc40e', 'volume_size': 1} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ea4392-6016-473a-96f8-dc59e29bc40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d1ce87264244288c1ecfa42c17808e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:33:54Z,use_quota=True,user_id='99f755d146244f66b9a325d8ac497212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Creating volume d9ea4392-6016-473a-96f8-dc59e29bc40e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:33:54 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:54 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e 1073741824 Jul 23 10:33:54 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:54 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e 1073741824" returned: 0 in 0.556s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:55 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e Jul 23 10:33:55 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:55 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e" returned: 0 in 0.258s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:33:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed5c344-be8a-4044-9365-8246d8cf41a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ea4392-6016-473a-96f8-dc59e29bc40e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd05317-33d7-43e6-8f07-dfa188724a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:33:55 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Volume volume-d9ea4392-6016-473a-96f8-dc59e29bc40e (d9ea4392-6016-473a-96f8-dc59e29bc40e): created successfully Jul 23 10:33:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd05317-33d7-43e6-8f07-dfa188724a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:33:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Flow 'volume_create_manager' (673993a5-dbb7-421c-94a0-a828d84cdea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:33:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9787ffab-d0ca-48f2-adc1-0a72ec2a68bd tempest-VolumesListAdminTestJSON-218684311 None] Created volume successfully. Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Acquiring lock "cinder-d9ea4392-6016-473a-96f8-dc59e29bc40e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Lock "cinder-d9ea4392-6016-473a-96f8-dc59e29bc40e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Acquiring lock "cinder-quobyte-d9ea4392-6016-473a-96f8-dc59e29bc40e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Lock "cinder-quobyte-d9ea4392-6016-473a-96f8-dc59e29bc40e" acquired by "delete_volume" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5ea1e4-6cc0-42e8-82f1-01f0d64b4464]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "cinder-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "cinder-quobyte-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-quobyte-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea54a3f-69d3-4ea4-b194-09e9dce11349]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:56 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e Jul 23 10:33:56 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:56 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8 Jul 23 10:33:56 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:57 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e" returned: 0 in 0.459s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:57 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e Jul 23 10:33:57 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:57 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8" returned: 0 in 0.427s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:57 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8 Jul 23 10:33:57 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:57 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9ea4392-6016-473a-96f8-dc59e29bc40e" returned: 0 in 0.297s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Lock "cinder-quobyte-d9ea4392-6016-473a-96f8-dc59e29bc40e" released by "delete_volume" :: held 0.824s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Created reservations ['91919eb6-544e-473d-9405-0e254f1e2aa4', 'a77d8a63-ac7e-4c4e-a6a0-6eaabb981ead', '2f9b689c-0e2d-40bb-9efe-e25997f2c984', 'b8e287a5-88f9-49f5-a855-14187f5cafa4'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:57 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8" returned: 0 in 0.278s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-quobyte-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8" released by "delete_volume" :: held 0.754s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:57 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:33:57 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Created reservations ['afda9aac-e4c6-4105-9bd5-e17269f40642', '994cc35c-1725-4716-bb3a-c8c7a2272f48', 'b0af433b-45a7-4072-83de-caa74c2bf272', '84b2ce56-14cb-498c-ad55-4ebb4321a659'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:57 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:33:57 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:57 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.315s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:57 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:33:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Deleted volume successfully. Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-139766cf-822a-4daf-b071-46c8af621318 tempest-VolumesListAdminTestJSON-218684311 None] Lock "cinder-d9ea4392-6016-473a-96f8-dc59e29bc40e-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "cinder-e41e47a2-e984-4a0b-ad5f-bcd461764083-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-e41e47a2-e984-4a0b-ad5f-bcd461764083-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "cinder-quobyte-e41e47a2-e984-4a0b-ad5f-bcd461764083" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:58 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.396s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-quobyte-e41e47a2-e984-4a0b-ad5f-bcd461764083" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:58 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Deleted volume successfully. Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c692a8-017e-4421-bd5e-262bbecd0c17]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d8d4abd3-5664-416a-a516-4d5fb8f4c9ec tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-2aeb4380-d0ba-4fbb-9f11-7f34b111ebd8-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:58 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083 Jul 23 10:33:58 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:58 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083" returned: 0 in 0.447s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:58 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083 Jul 23 10:33:58 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:58 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e41e47a2-e984-4a0b-ad5f-bcd461764083" returned: 0 in 0.325s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-quobyte-e41e47a2-e984-4a0b-ad5f-bcd461764083" released by "delete_volume" :: held 0.822s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Created reservations ['48530907-5166-458f-bb4b-c70bd7a1ac42', 'c4a13472-98c5-4d70-a907-666eeba2692a', '48db589e-e296-44c4-b997-fbacd2fe1ded', '17d2fd22-94ec-4b2d-9e97-a01dda3bc221'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:59 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:33:59 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "cinder-37502663-fa5e-4e4d-9a78-36ba76c5543d-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-37502663-fa5e-4e4d-9a78-36ba76c5543d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "cinder-quobyte-37502663-fa5e-4e4d-9a78-36ba76c5543d" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-quobyte-37502663-fa5e-4e4d-9a78-36ba76c5543d" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:33:59 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5e4072-8793-49d1-84ca-d1cfb4da05fd]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.299s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:33:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Deleted volume successfully. Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-efc2cf4d-1459-4ac1-9f43-5c38ffe1b676 tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-e41e47a2-e984-4a0b-ad5f-bcd461764083-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:33:59 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d Jul 23 10:33:59 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:33:59 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:33:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:33:59 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d Jul 23 10:33:59 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:00 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37502663-fa5e-4e4d-9a78-36ba76c5543d" returned: 0 in 0.265s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-quobyte-37502663-fa5e-4e4d-9a78-36ba76c5543d" released by "delete_volume" :: held 0.708s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Created reservations ['e66b60f6-84ca-441e-8abf-4e7c71c9020d', 'eda83250-c11e-4852-abe5-29fa695698f3', '6a6ab21a-91fa-483f-808c-e3d977a7e688', '36d05b57-e730-4bfc-99d6-9c1b2f62440f'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:00 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:34:00 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:00 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.296s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:34:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Deleted volume successfully. Jul 23 10:34:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2105aa20-c3d1-492c-b186-272209f3b309 tempest-VolumesListAdminTestJSON-354590759 None] Lock "cinder-37502663-fa5e-4e4d-9a78-36ba76c5543d-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Flow 'volume_create_manager' (f68e4dc6-fd8b-4ff4-be7f-eb5e70b8c19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8a4a1b-6a92-454c-9627-2299634a3eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8a4a1b-6a92-454c-9627-2299634a3eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-979202350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd847a5-e7b0-48b5-954f-4cf7c34d584b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8c9145cfe144f6b63564c065e91e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:34:08Z,use_quota=True,user_id='31bed1159c8d4b14b3db9cfe1feafc0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abb5630-3a31-406f-bb08-d9b7c1298373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abb5630-3a31-406f-bb08-d9b7c1298373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54d6f21-dd51-4232-acd3-a877debf7d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.image.glance [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Creating Keystone auth plugin from conf {{(pid=88371) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54d6f21-dd51-4232-acd3-a877debf7d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8bd847a5-e7b0-48b5-954f-4cf7c34d584b', 'volume_name': 'volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12f17dc-87eb-447d-a25c-bee7635eb62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12f17dc-87eb-447d-a25c-bee7635eb62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b84a79-02ed-47e7-a502-fdcdbbc90e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:08 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Volume 8bd847a5-e7b0-48b5-954f-4cf7c34d584b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Trying to clone 8bd847a5-e7b0-48b5-954f-4cf7c34d584b from image c7e93a9b-febb-49a8-91b3-5378e004c880 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]). {{(pid=88371) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 10:34:08 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Image download 20.69 MB at 20.69 MB/s Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c8969a-74be-491a-834d-7c0f67fa4778]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:09 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD Jul 23 10:34:09 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:09 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Temporary image c7e93a9b-febb-49a8-91b3-5378e004c880 is fetched for user 31bed1159c8d4b14b3db9cfe1feafc0a. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade7a8be-4d1c-404c-884d-6606e00b250d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:09 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD Jul 23 10:34:09 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:09 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-979202350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd847a5-e7b0-48b5-954f-4cf7c34d584b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8c9145cfe144f6b63564c065e91e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:34:08Z,use_quota=True,user_id='31bed1159c8d4b14b3db9cfe1feafc0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Creating volume 8bd847a5-e7b0-48b5-954f-4cf7c34d584b {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:34:09 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:34:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:09 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b 1073741824 Jul 23 10:34:09 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:10 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b 1073741824" returned: 0 in 0.442s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:10 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b Jul 23 10:34:10 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:10 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:34:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:10 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Attempting download of c7e93a9b-febb-49a8-91b3-5378e004c880 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}])) to volume 8bd847a5-e7b0-48b5-954f-4cf7c34d584b. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 10:34:10 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af78498-a52a-477b-af9c-4c025a25a983]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_w8j6o4e_ {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:10 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_w8j6o4e_ Jul 23 10:34:10 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:10 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_w8j6o4e_" returned: 0 in 0.354s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_w8j6o4e_ {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:11 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_w8j6o4e_ Jul 23 10:34:11 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:11 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_w8j6o4e_" returned: 1 in 0.351s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7e93a9b-febb-49a8-91b3-5378e004c880_w8j6o4e_' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:34:11 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9a19b8-03bf-4280-9ed8-bbb43e1e38d9]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:11 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD Jul 23 10:34:11 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:11 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:11 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] c7e93a9b-febb-49a8-91b3-5378e004c880 was qcow2, converting to qcow2 {{(pid=88371) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 10:34:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:11 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b Jul 23 10:34:11 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:13 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b" returned: 0 in 1.797s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c7e93a9b-febb-49a8-91b3-5378e004c880_throtqendevstack@QuobyteHD, size 112.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:34:13 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Converted 112.00 MB image at 62.28 MB/s Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:13 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b 1G Jul 23 10:34:13 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:13 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b 1G" returned: 0 in 0.368s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Downloaded image c7e93a9b-febb-49a8-91b3-5378e004c880 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}])) to volume 8bd847a5-e7b0-48b5-954f-4cf7c34d584b successfully. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Temporary image c7e93a9b-febb-49a8-91b3-5378e004c880 for user 31bed1159c8d4b14b3db9cfe1feafc0a is deleted. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Marking volume 8bd847a5-e7b0-48b5-954f-4cf7c34d584b as bootable. {{(pid=88371) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Copying metadata from image c7e93a9b-febb-49a8-91b3-5378e004c880 to 8bd847a5-e7b0-48b5-954f-4cf7c34d584b. {{(pid=88371) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Creating volume glance metadata for volume 8bd847a5-e7b0-48b5-954f-4cf7c34d584b backed by image c7e93a9b-febb-49a8-91b3-5378e004c880 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88371) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b84a79-02ed-47e7-a502-fdcdbbc90e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b', 'volume_size': 1, 'image_id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7e93a9b-febb-49a8-91b3-5378e004c880', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '359297b5991b4337891145d831945b27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c7e93a9b-febb-49a8-91b3-5378e004c880', 'created_at': datetime.datetime(2026, 7, 23, 8, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 14, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7e93a9b-febb-49a8-91b3-5378e004c880/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c51a50-5e9d-4697-af93-3751796d9f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:13 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Volume volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b (8bd847a5-e7b0-48b5-954f-4cf7c34d584b): created successfully Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c51a50-5e9d-4697-af93-3751796d9f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Flow 'volume_create_manager' (f68e4dc6-fd8b-4ff4-be7f-eb5e70b8c19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:13 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e74294af-978e-4a83-9915-29ae73b40a82 tempest-VolumesImageMetadata-1913696214 None] Created volume successfully. Jul 23 10:34:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Acquiring lock "cinder-8bd847a5-e7b0-48b5-954f-4cf7c34d584b-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Lock "cinder-8bd847a5-e7b0-48b5-954f-4cf7c34d584b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Acquiring lock "cinder-quobyte-8bd847a5-e7b0-48b5-954f-4cf7c34d584b" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Lock "cinder-quobyte-8bd847a5-e7b0-48b5-954f-4cf7c34d584b" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6216f5-71ae-416d-b79f-00cca20cee23]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:15 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b Jul 23 10:34:15 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:15 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b" returned: 0 in 0.385s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:15 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b Jul 23 10:34:15 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:15 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8bd847a5-e7b0-48b5-954f-4cf7c34d584b" returned: 0 in 0.260s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Lock "cinder-quobyte-8bd847a5-e7b0-48b5-954f-4cf7c34d584b" released by "delete_volume" :: held 0.695s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Created reservations ['3cc18f50-e4e2-4595-bf46-7d87a138245f', '56a8c54a-ad56-4370-9179-527399f1c18a', '02ed6af5-74f8-4583-b134-c9cc84e1dc5c', '2afd983b-5802-4239-8277-49cb32b603c4'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:15 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:34:15 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:16 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.549s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:16 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:34:16 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Deleted volume successfully. Jul 23 10:34:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1cc39838-999a-49f4-81c3-f37fc5217dcf tempest-VolumesImageMetadata-1913696214 None] Lock "cinder-8bd847a5-e7b0-48b5-954f-4cf7c34d584b-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Flow 'volume_create_manager' (f723d8d7-3cfd-4e83-8475-344c88ddcaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda0b13a-50ff-4908-aeff-903bcbbd4299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda0b13a-50ff-4908-aeff-903bcbbd4299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-910213239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf896c076d2c43c8ab6b00c42b5613bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:34:21Z,use_quota=True,user_id='88c2d71bbcaa4560925e85423c63dfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f58326f-0d00-41c3-9927-66502c42484c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f58326f-0d00-41c3-9927-66502c42484c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa4cb70-3d1a-4234-b4fb-a44f66f6c336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa4cb70-3d1a-4234-b4fb-a44f66f6c336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8', 'volume_name': 'volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b590f16-6945-4d33-b642-db4cb6defb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b590f16-6945-4d33-b642-db4cb6defb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877809ed-5c1e-4b21-8e32-1d55bfae300c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:21 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Volume 3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8', 'volume_size': 1} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-910213239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf896c076d2c43c8ab6b00c42b5613bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:34:21Z,use_quota=True,user_id='88c2d71bbcaa4560925e85423c63dfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Creating volume 3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:34:21 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:34:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:21 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8 1073741824 Jul 23 10:34:21 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:22 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8 1073741824" returned: 0 in 0.432s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:22 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8 Jul 23 10:34:22 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:22 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8" returned: 0 in 0.280s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:34:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877809ed-5c1e-4b21-8e32-1d55bfae300c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736ca859-f0b5-481f-b963-2487682ac116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:22 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Volume volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8 (3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8): created successfully Jul 23 10:34:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736ca859-f0b5-481f-b963-2487682ac116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Flow 'volume_create_manager' (f723d8d7-3cfd-4e83-8475-344c88ddcaef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:22 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3febbd10-e569-47b0-9956-0e52e576bcef tempest-TestMinimumBasicScenario-441670662 None] Created volume successfully. Jul 23 10:34:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-d8e2f1a6-f43a-45df-88f9-5b5bf1da5b75 req-93968e24-6989-4d62-8a05-b051020fd698 tempest-TestMinimumBasicScenario-441670662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-d8e2f1a6-f43a-45df-88f9-5b5bf1da5b75 req-93968e24-6989-4d62-8a05-b051020fd698 tempest-TestMinimumBasicScenario-441670662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-d8e2f1a6-f43a-45df-88f9-5b5bf1da5b75 req-93968e24-6989-4d62-8a05-b051020fd698 tempest-TestMinimumBasicScenario-441670662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:25 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-d8e2f1a6-f43a-45df-88f9-5b5bf1da5b75 req-93968e24-6989-4d62-8a05-b051020fd698 tempest-TestMinimumBasicScenario-441670662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a69baa5-31b4-4d39-bcf5-35ea8383d088', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:34:25 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-d8e2f1a6-f43a-45df-88f9-5b5bf1da5b75 req-93968e24-6989-4d62-8a05-b051020fd698 tempest-TestMinimumBasicScenario-441670662 None] attachment_update completed successfully. Jul 23 10:34:32 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=72,cinder:INSERT=25,cinder:UPDATE=94,cinder:DELETE=11 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:34:32 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=73,cinder:UPDATE=81,cinder:INSERT=28,cinder:DELETE=4 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:34:32 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Flow 'volume_create_manager' (0ea32e01-f896-4d9a-ae40-6dd33eb44ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20559db1-eb58-4349-af1c-ad74dd08869c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20559db1-eb58-4349-af1c-ad74dd08869c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-966921769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af66a6fa-8fc1-4528-9816-4062a31a6112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b2345e3ad1494d9eac7730da559acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:34:33Z,use_quota=True,user_id='1710c27d9ab5447bbda8976dcf983ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e69130-3765-412b-a360-36556f3370e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e69130-3765-412b-a360-36556f3370e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d34e075-2651-4aca-95aa-a8a56add967a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d34e075-2651-4aca-95aa-a8a56add967a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af66a6fa-8fc1-4528-9816-4062a31a6112', 'volume_name': 'volume-af66a6fa-8fc1-4528-9816-4062a31a6112', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dad66e6-f2be-4200-a630-64d2ae7e9dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dad66e6-f2be-4200-a630-64d2ae7e9dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13432291-f1aa-4429-8357-8a0cced803b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:33 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Volume af66a6fa-8fc1-4528-9816-4062a31a6112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af66a6fa-8fc1-4528-9816-4062a31a6112', 'volume_size': 1} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-966921769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af66a6fa-8fc1-4528-9816-4062a31a6112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b2345e3ad1494d9eac7730da559acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:34:33Z,use_quota=True,user_id='1710c27d9ab5447bbda8976dcf983ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Creating volume af66a6fa-8fc1-4528-9816-4062a31a6112 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:34:33 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:33 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 1073741824 Jul 23 10:34:33 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:33 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 1073741824" returned: 0 in 0.449s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:33 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 Jul 23 10:34:33 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:33 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112" returned: 0 in 0.268s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13432291-f1aa-4429-8357-8a0cced803b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af66a6fa-8fc1-4528-9816-4062a31a6112', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0303e2e-c7e7-4f8c-ade7-fafd79183ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:33 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Volume volume-af66a6fa-8fc1-4528-9816-4062a31a6112 (af66a6fa-8fc1-4528-9816-4062a31a6112): created successfully Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0303e2e-c7e7-4f8c-ade7-fafd79183ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Flow 'volume_create_manager' (0ea32e01-f896-4d9a-ae40-6dd33eb44ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:33 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d8bbfede-f7d0-4407-987b-af4867a6a354 tempest-VolumesSnapshotTestJSON-1787400501 None] Created volume successfully. Jul 23 10:34:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] Creating offline snapshot d8a6c832-5ef2-42e6-9f0b-4a995ad367fa of volume af66a6fa-8fc1-4528-9816-4062a31a6112 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:34:35 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e46391-63e6-40b4-86b2-68cf1eaaadf6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:35 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 Jul 23 10:34:35 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:35 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112" returned: 0 in 0.395s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:35 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa 1G Jul 23 10:34:35 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:35 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa 1G" returned: 0 in 0.474s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af66a6fa-8fc1-4528-9816-4062a31a6112 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:36 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af66a6fa-8fc1-4528-9816-4062a31a6112 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa Jul 23 10:34:36 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:36 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af66a6fa-8fc1-4528-9816-4062a31a6112 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa" returned: 0 in 0.294s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:36 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa is being set with open permissions: ugo+rw Jul 23 10:34:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:36 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa Jul 23 10:34:36 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:36 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa" returned: 0 in 0.242s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:36 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.info Jul 23 10:34:36 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:36 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.info" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:36 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.info is being set with open permissions: ugo+rw Jul 23 10:34:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:36 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.info Jul 23 10:34:36 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:37 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.info" returned: 0 in 0.261s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:37 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e679bda9-7e2d-43a7-925e-5bc31f0a11ba tempest-VolumesSnapshotTestJSON-1787400501 None] Create snapshot completed successfully Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-d8a6c832-5ef2-42e6-9f0b-4a995ad367fa-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-d8a6c832-5ef2-42e6-9f0b-4a995ad367fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-af66a6fa-8fc1-4528-9816-4062a31a6112" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-af66a6fa-8fc1-4528-9816-4062a31a6112" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-d8a6c832-5ef2-42e6-9f0b-4a995ad367fa" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-d8a6c832-5ef2-42e6-9f0b-4a995ad367fa" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Deleting offline snapshot d8a6c832-5ef2-42e6-9f0b-4a995ad367fa of volume af66a6fa-8fc1-4528-9816-4062a31a6112 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] snapshot_file for this snap is: volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7153a03-0d1d-4878-a9cd-de9477a4bd97]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:38 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa Jul 23 10:34:38 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:38 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa" returned: 0 in 0.394s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af66a6fa-8fc1-4528-9816-4062a31a6112(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9162e084-6f54-49d6-8f6d-0bb1074b1cdb]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:38 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 Jul 23 10:34:38 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:39 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112" returned: 0 in 0.366s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:39 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa Jul 23 10:34:39 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:39 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa" returned: 0 in 0.341s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:39 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa Jul 23 10:34:39 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:39 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112.d8a6c832-5ef2-42e6-9f0b-4a995ad367fa" returned: 0 in 0.247s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-d8a6c832-5ef2-42e6-9f0b-4a995ad367fa" released by "_delete_snapshot" :: held 1.460s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-af66a6fa-8fc1-4528-9816-4062a31a6112" released by "delete_snapshot" :: held 1.487s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:39 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Created reservations ['0eab1296-5d0e-441a-8785-c049b59916df', '1e6647d0-7b02-4ad1-a664-457b57b60c60', 'ba04deef-b51c-4f82-aa0e-4c13cf6b75f2', '94b2dafe-11e5-4143-94a6-6e77c08fcbe7'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:34:39 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Delete snapshot completed successfully. Jul 23 10:34:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c6ceca8b-7ced-4462-b03b-220757bb524d tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-d8a6c832-5ef2-42e6-9f0b-4a995ad367fa-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Flow 'volume_create_manager' (02509c44-a54e-45f0-b09d-6a9298293efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239b4891-827a-4aa2-8d14-d97856f350f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239b4891-827a-4aa2-8d14-d97856f350f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1001763590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=638efcb6-5703-4a43-828a-ee1550809427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b2345e3ad1494d9eac7730da559acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:34:41Z,use_quota=True,user_id='1710c27d9ab5447bbda8976dcf983ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91c47cd-2f88-4c63-bdc6-36764d9e392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91c47cd-2f88-4c63-bdc6-36764d9e392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b494abfe-ec1c-4efc-839c-a99a56624c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b494abfe-ec1c-4efc-839c-a99a56624c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '638efcb6-5703-4a43-828a-ee1550809427', 'volume_name': 'volume-638efcb6-5703-4a43-828a-ee1550809427', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb276a9-76a6-4add-ac7f-31a087b4eb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb276a9-76a6-4add-ac7f-31a087b4eb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa2d886-9005-4e48-bce4-eff5cef649fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:41 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Volume 638efcb6-5703-4a43-828a-ee1550809427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-638efcb6-5703-4a43-828a-ee1550809427', 'volume_size': 1} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1001763590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=638efcb6-5703-4a43-828a-ee1550809427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b2345e3ad1494d9eac7730da559acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:34:41Z,use_quota=True,user_id='1710c27d9ab5447bbda8976dcf983ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Creating volume 638efcb6-5703-4a43-828a-ee1550809427 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:34:41 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:41 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 1073741824 Jul 23 10:34:41 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:41 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 1073741824" returned: 0 in 0.544s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:41 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 Jul 23 10:34:41 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:42 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427" returned: 0 in 0.343s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:34:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa2d886-9005-4e48-bce4-eff5cef649fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-638efcb6-5703-4a43-828a-ee1550809427', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174e2e79-578e-4dde-84e7-be8160e69c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:42 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Volume volume-638efcb6-5703-4a43-828a-ee1550809427 (638efcb6-5703-4a43-828a-ee1550809427): created successfully Jul 23 10:34:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174e2e79-578e-4dde-84e7-be8160e69c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:42 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Flow 'volume_create_manager' (02509c44-a54e-45f0-b09d-6a9298293efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:42 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-cee12064-0a24-4994-97c2-04e1d8c6390b tempest-VolumesSnapshotTestJSON-1787400501 None] Created volume successfully. Jul 23 10:34:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] Creating offline snapshot e85f36f9-638c-4bc4-bba3-6a0774872714 of volume 638efcb6-5703-4a43-828a-ee1550809427 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:34:43 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0f64de-fdff-4da3-b77f-57886b46011c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:43 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 Jul 23 10:34:43 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:43 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427" returned: 0 in 0.343s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:43 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 1G Jul 23 10:34:43 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:44 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 1G" returned: 0 in 0.378s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638efcb6-5703-4a43-828a-ee1550809427 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:44 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638efcb6-5703-4a43-828a-ee1550809427 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 Jul 23 10:34:44 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:44 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638efcb6-5703-4a43-828a-ee1550809427 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714" returned: 0 in 0.286s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:44 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 is being set with open permissions: ugo+rw Jul 23 10:34:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:44 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 Jul 23 10:34:44 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:44 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714" returned: 0 in 0.233s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:44 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.info Jul 23 10:34:44 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:44 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.info" returned: 0 in 0.249s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:44 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.info is being set with open permissions: ugo+rw Jul 23 10:34:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:44 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.info Jul 23 10:34:44 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:45 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.info" returned: 0 in 0.245s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:45 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1aec3cb1-67bd-484a-b549-0c52b7913f47 tempest-VolumesSnapshotTestJSON-1787400501 None] Create snapshot completed successfully Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Flow 'volume_create_manager' (674bbf94-9d13-4df8-b809-8a5ca01896ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9920ccc5-8720-45c2-ab33-a4e7c4530531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9920ccc5-8720-45c2-ab33-a4e7c4530531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1545524082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c50bce6-1353-4bb4-9f5c-48f32a08e08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b2345e3ad1494d9eac7730da559acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:34:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e85f36f9-638c-4bc4-bba3-6a0774872714,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:34:46Z,use_quota=True,user_id='1710c27d9ab5447bbda8976dcf983ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04b9d28-d464-4bdd-952e-4225382b4f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04b9d28-d464-4bdd-952e-4225382b4f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa7ff40-c911-433a-8881-d531c17fd0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa7ff40-c911-433a-8881-d531c17fd0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2c50bce6-1353-4bb4-9f5c-48f32a08e08a', 'volume_name': 'volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a', 'volume_size': 2, 'snapshot_id': 'e85f36f9-638c-4bc4-bba3-6a0774872714'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d426ca-43e4-478a-8601-cd14926f6355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d426ca-43e4-478a-8601-cd14926f6355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fc91bc-a427-4c06-b88a-fd5bde5cd348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:46 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Volume 2c50bce6-1353-4bb4-9f5c-48f32a08e08a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a', 'volume_size': 2, 'snapshot_id': 'e85f36f9-638c-4bc4-bba3-6a0774872714'} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-e85f36f9-638c-4bc4-bba3-6a0774872714-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" by "_create_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-e85f36f9-638c-4bc4-bba3-6a0774872714-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Creating volume 2c50bce6-1353-4bb4-9f5c-48f32a08e08a from snapshot e85f36f9-638c-4bc4-bba3-6a0774872714 {{(pid=88371) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] snapshot: e85f36f9-638c-4bc4-bba3-6a0774872714, volume: 2c50bce6-1353-4bb4-9f5c-48f32a08e08a, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d501126b-5c68-4f20-b16f-112519acfd15]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:46 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 Jul 23 10:34:46 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:46 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:34:46 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:46 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714" returned: 0 in 0.373s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638efcb6-5703-4a43-828a-ee1550809427(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf312ff-4e6c-42d0-897f-329a2cbb6b3c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:46 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.271s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:34:46 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 Jul 23 10:34:46 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:46 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427" returned: 0 in 0.415s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:34:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:46 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a Jul 23 10:34:46 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:52 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" returned: 0 in 5.388s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:52 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76bb0ff-3dc0-4af3-b012-883d46a56af0]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:52 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 Jul 23 10:34:52 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:52 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427" returned: 0 in 0.530s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:52 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:34:52 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Converted 1024.00 MB image at 189.99 MB/s Jul 23 10:34:52 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a is being set with open permissions: ugo+rw Jul 23 10:34:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:52 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a Jul 23 10:34:52 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:53 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" returned: 0 in 0.240s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" released by "_copy_volume_from_snapshot" :: held 7.051s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-e85f36f9-638c-4bc4-bba3-6a0774872714-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" released by "_create_volume_from_snapshot" :: held 7.081s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.097s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fc91bc-a427-4c06-b88a-fd5bde5cd348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a', 'volume_size': 2, 'snapshot_id': 'e85f36f9-638c-4bc4-bba3-6a0774872714'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d56cd9-274b-40bd-8c19-5845b56fb30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:53 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Volume volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a (2c50bce6-1353-4bb4-9f5c-48f32a08e08a): created successfully Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d56cd9-274b-40bd-8c19-5845b56fb30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Flow 'volume_create_manager' (674bbf94-9d13-4df8-b809-8a5ca01896ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9459c7e3-0200-4d23-8013-71c2c4dc7816 tempest-VolumesSnapshotTestJSON-1787400501 None] Created volume successfully. Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-2c50bce6-1353-4bb4-9f5c-48f32a08e08a-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-2c50bce6-1353-4bb4-9f5c-48f32a08e08a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5308b46d-df43-4142-b8bb-9729b38b3025]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:54 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a Jul 23 10:34:54 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:54 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" returned: 0 in 0.352s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:54 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a Jul 23 10:34:54 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:54 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" returned: 0 in 0.240s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-2c50bce6-1353-4bb4-9f5c-48f32a08e08a" released by "delete_volume" :: held 0.634s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Created reservations ['1b773ad5-e8c5-4d5b-926f-94994dab71a6', '4a36d641-9959-4cea-b620-548569aac3f8', 'fe4f42ee-ad34-4922-a3eb-718282936115', '522a6d39-97bc-4253-8ace-6a67a0b1232b'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:54 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:34:54 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:54 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.241s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:34:54 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Deleted volume successfully. Jul 23 10:34:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7763ce5d-ad27-4054-bcfa-fe01159fae80 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-2c50bce6-1353-4bb4-9f5c-48f32a08e08a-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-e85f36f9-638c-4bc4-bba3-6a0774872714-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-e85f36f9-638c-4bc4-bba3-6a0774872714-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-638efcb6-5703-4a43-828a-ee1550809427" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-638efcb6-5703-4a43-828a-ee1550809427" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-e85f36f9-638c-4bc4-bba3-6a0774872714" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-e85f36f9-638c-4bc4-bba3-6a0774872714" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Deleting offline snapshot e85f36f9-638c-4bc4-bba3-6a0774872714 of volume 638efcb6-5703-4a43-828a-ee1550809427 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] snapshot_file for this snap is: volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[300af786-6613-4c95-b982-ec9b3be1ba5f]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:55 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 Jul 23 10:34:55 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:55 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714" returned: 0 in 0.359s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638efcb6-5703-4a43-828a-ee1550809427(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[568aaa8d-fdf2-414a-92b0-0260a54d13ba]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:55 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 Jul 23 10:34:55 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:55 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427" returned: 0 in 0.360s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:55 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 Jul 23 10:34:55 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:56 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714" returned: 0 in 0.339s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:56 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714 Jul 23 10:34:56 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:56 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427.e85f36f9-638c-4bc4-bba3-6a0774872714" returned: 0 in 0.243s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-e85f36f9-638c-4bc4-bba3-6a0774872714" released by "_delete_snapshot" :: held 1.398s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-638efcb6-5703-4a43-828a-ee1550809427" released by "delete_snapshot" :: held 1.425s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:56 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Created reservations ['76a1677c-c400-49b0-bb6e-305faf0538bc', '313092ed-4f19-4ec1-9ec7-673fddb90030', '142c579e-0999-4822-bd79-c11d1c5e9746', '33ed2dcb-0229-4abc-9ae8-71ae322e05fa'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:34:56 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Delete snapshot completed successfully. Jul 23 10:34:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f5b99f01-a174-4540-b67e-7910df4ad59b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-e85f36f9-638c-4bc4-bba3-6a0774872714-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-638efcb6-5703-4a43-828a-ee1550809427-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-638efcb6-5703-4a43-828a-ee1550809427-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-638efcb6-5703-4a43-828a-ee1550809427" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:34:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-638efcb6-5703-4a43-828a-ee1550809427" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:34:57 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[1879603f-576f-4038-85b6-64d32fbaf790]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:34:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:57 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 Jul 23 10:34:57 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:57 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427" returned: 0 in 0.364s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:57 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427 Jul 23 10:34:57 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:58 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-638efcb6-5703-4a43-828a-ee1550809427" returned: 0 in 0.250s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-638efcb6-5703-4a43-828a-ee1550809427" released by "delete_volume" :: held 0.677s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Created reservations ['5762181a-221c-4126-a230-1ae58f882ded', '33297f60-9064-4246-9e83-19bb38a3937e', '30721e0d-785a-43ac-acae-15a926a4282b', '4bdf68cb-081a-430a-8ff0-1cd3051a6cc0'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:58 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:34:58 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:58 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.259s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:34:58 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Deleted volume successfully. Jul 23 10:34:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a26d3ac5-b282-4b9b-8a9b-e582bc3cef57 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-638efcb6-5703-4a43-828a-ee1550809427-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Flow 'volume_create_manager' (356ff168-62a0-4f21-bd1d-76ffcdc62022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b62aa8-e82a-4b8d-a8cb-5880684278b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b62aa8-e82a-4b8d-a8cb-5880684278b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1816764717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ba16ea-47e5-4af8-b102-3b2a6e409dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b2345e3ad1494d9eac7730da559acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:34:59Z,use_quota=True,user_id='1710c27d9ab5447bbda8976dcf983ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ffb3b6-bb3b-4e44-92bf-1a6c1a8edcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ffb3b6-bb3b-4e44-92bf-1a6c1a8edcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda2a216-9d02-40c8-adb7-98482518502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda2a216-9d02-40c8-adb7-98482518502e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ba16ea-47e5-4af8-b102-3b2a6e409dd7', 'volume_name': 'volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3771cb2a-c38b-42ce-bb2f-ed144896b7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3771cb2a-c38b-42ce-bb2f-ed144896b7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4f4404-b3dd-4438-aea2-703f53fcce7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Volume 91ba16ea-47e5-4af8-b102-3b2a6e409dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7', 'volume_size': 1} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1816764717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ba16ea-47e5-4af8-b102-3b2a6e409dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b2345e3ad1494d9eac7730da559acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:34:59Z,use_quota=True,user_id='1710c27d9ab5447bbda8976dcf983ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Creating volume 91ba16ea-47e5-4af8-b102-3b2a6e409dd7 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:34:59 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:59 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 1073741824 Jul 23 10:34:59 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:59 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 1073741824" returned: 0 in 0.407s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:34:59 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 Jul 23 10:34:59 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:34:59 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" returned: 0 in 0.242s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4f4404-b3dd-4438-aea2-703f53fcce7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1deeec5a-98f4-4d96-8884-2f9985009bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:34:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Volume volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 (91ba16ea-47e5-4af8-b102-3b2a6e409dd7): created successfully Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1deeec5a-98f4-4d96-8884-2f9985009bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:34:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Flow 'volume_create_manager' (356ff168-62a0-4f21-bd1d-76ffcdc62022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:34:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7d5bbb08-d2e3-46b7-a7e3-3f5672e74220 tempest-VolumesSnapshotTestJSON-1787400501 None] Created volume successfully. Jul 23 10:35:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] Creating offline snapshot 1a1708cb-de8f-4328-a5dc-a824562aef25 of volume 91ba16ea-47e5-4af8-b102-3b2a6e409dd7 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:35:00 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca04057c-01e0-4cc1-8eaf-f675bb75b29d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:00 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 Jul 23 10:35:00 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:00 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" returned: 0 in 0.448s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:00 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 1G Jul 23 10:35:00 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:01 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 1G" returned: 0 in 0.442s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:01 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 Jul 23 10:35:01 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:01 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25" returned: 0 in 0.292s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:01 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 is being set with open permissions: ugo+rw Jul 23 10:35:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:01 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 Jul 23 10:35:01 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:01 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:01 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.info Jul 23 10:35:01 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:01 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.info" returned: 0 in 0.250s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:01 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.info is being set with open permissions: ugo+rw Jul 23 10:35:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:02 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.info Jul 23 10:35:02 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:02 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.info" returned: 0 in 0.245s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:02 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-2308dba9-d97c-431f-8864-68adc46e9a0e tempest-VolumesSnapshotTestJSON-1787400501 None] Create snapshot completed successfully Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Flow 'volume_create_manager' (d52d6137-2180-4643-bd97-7c61cbf262b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89acfc73-7b98-4e78-bc02-25f347e52020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89acfc73-7b98-4e78-bc02-25f347e52020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1286209064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1359089-86eb-46d7-9ad1-6be97afbb679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b2345e3ad1494d9eac7730da559acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a1708cb-de8f-4328-a5dc-a824562aef25,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:03Z,use_quota=True,user_id='1710c27d9ab5447bbda8976dcf983ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8d5d10-b0e8-4a5e-8519-c692496cded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8d5d10-b0e8-4a5e-8519-c692496cded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e180d14-ca9b-4fe1-a25f-1fd5d5d424ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e180d14-ca9b-4fe1-a25f-1fd5d5d424ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e1359089-86eb-46d7-9ad1-6be97afbb679', 'volume_name': 'volume-e1359089-86eb-46d7-9ad1-6be97afbb679', 'volume_size': 1, 'snapshot_id': '1a1708cb-de8f-4328-a5dc-a824562aef25'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a5c0c6-d7fd-4d0a-95b5-3f2a33ed9e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a5c0c6-d7fd-4d0a-95b5-3f2a33ed9e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43fe9b5-21cc-481b-8156-cf0bc1f51333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:02 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Volume e1359089-86eb-46d7-9ad1-6be97afbb679: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e1359089-86eb-46d7-9ad1-6be97afbb679', 'volume_size': 1, 'snapshot_id': '1a1708cb-de8f-4328-a5dc-a824562aef25'} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-1a1708cb-de8f-4328-a5dc-a824562aef25-e1359089-86eb-46d7-9ad1-6be97afbb679" by "_create_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-1a1708cb-de8f-4328-a5dc-a824562aef25-e1359089-86eb-46d7-9ad1-6be97afbb679" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Creating volume e1359089-86eb-46d7-9ad1-6be97afbb679 from snapshot 1a1708cb-de8f-4328-a5dc-a824562aef25 {{(pid=88371) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-e1359089-86eb-46d7-9ad1-6be97afbb679" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-e1359089-86eb-46d7-9ad1-6be97afbb679" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] snapshot: 1a1708cb-de8f-4328-a5dc-a824562aef25, volume: e1359089-86eb-46d7-9ad1-6be97afbb679, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4825f4-39cd-49b4-872e-fc6082065410]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:03 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 Jul 23 10:35:03 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:03 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25" returned: 0 in 0.361s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63ac6fa-5dc2-45d7-9744-f4c5fe217265]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:03 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 Jul 23 10:35:03 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:03 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" returned: 0 in 0.391s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679 not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:35:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:03 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679 Jul 23 10:35:03 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:07 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679" returned: 0 in 4.082s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[115510af-8081-401f-938f-dec6ada801fb]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:08 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 Jul 23 10:35:08 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:08 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" returned: 0 in 0.573s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:08 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7, size 1024.00 MB, duration 4.08 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:35:08 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Converted 1024.00 MB image at 250.75 MB/s Jul 23 10:35:08 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679 is being set with open permissions: ugo+rw Jul 23 10:35:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:08 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679 Jul 23 10:35:08 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:08 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679" returned: 0 in 0.258s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-e1359089-86eb-46d7-9ad1-6be97afbb679" released by "_copy_volume_from_snapshot" :: held 5.756s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-1a1708cb-de8f-4328-a5dc-a824562aef25-e1359089-86eb-46d7-9ad1-6be97afbb679" released by "_create_volume_from_snapshot" :: held 5.787s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.805s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43fe9b5-21cc-481b-8156-cf0bc1f51333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1359089-86eb-46d7-9ad1-6be97afbb679', 'volume_size': 1, 'snapshot_id': '1a1708cb-de8f-4328-a5dc-a824562aef25'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc91649f-f065-411d-84b5-ebc440bc0fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:08 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Volume volume-e1359089-86eb-46d7-9ad1-6be97afbb679 (e1359089-86eb-46d7-9ad1-6be97afbb679): created successfully Jul 23 10:35:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc91649f-f065-411d-84b5-ebc440bc0fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Flow 'volume_create_manager' (d52d6137-2180-4643-bd97-7c61cbf262b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:08 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f60e087f-9d04-4a2c-9dab-0e137b69790e tempest-VolumesSnapshotTestJSON-1787400501 None] Created volume successfully. Jul 23 10:35:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-e1359089-86eb-46d7-9ad1-6be97afbb679-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-e1359089-86eb-46d7-9ad1-6be97afbb679-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-e1359089-86eb-46d7-9ad1-6be97afbb679" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-e1359089-86eb-46d7-9ad1-6be97afbb679" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:09 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[565532f2-2246-417c-9825-d87517e75b21]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:09 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679 Jul 23 10:35:09 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:09 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679" returned: 0 in 0.342s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:09 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679 Jul 23 10:35:09 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:10 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e1359089-86eb-46d7-9ad1-6be97afbb679" returned: 0 in 0.240s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-e1359089-86eb-46d7-9ad1-6be97afbb679" released by "delete_volume" :: held 0.621s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Created reservations ['d62c5f91-b654-488c-b4ff-5eea4cf2e43e', '71becf43-ef27-4f4c-a9aa-eaf80ba16423', 'b42a5f8e-c7ce-4dc8-9450-9d63f45bd40e', '81d57d23-92cc-45a2-8337-d59c0f73f3c8'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:10 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:35:10 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:10 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.252s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:35:10 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Deleted volume successfully. Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd6a430b-1bad-4322-a7e9-b35d0c4ad898 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-e1359089-86eb-46d7-9ad1-6be97afbb679-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-1a1708cb-de8f-4328-a5dc-a824562aef25-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-1a1708cb-de8f-4328-a5dc-a824562aef25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-1a1708cb-de8f-4328-a5dc-a824562aef25" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-1a1708cb-de8f-4328-a5dc-a824562aef25" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Deleting offline snapshot 1a1708cb-de8f-4328-a5dc-a824562aef25 of volume 91ba16ea-47e5-4af8-b102-3b2a6e409dd7 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] snapshot_file for this snap is: volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6034c2-ea87-482d-9a15-565e65c33df2]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:10 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 Jul 23 10:35:10 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:11 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25" returned: 0 in 0.379s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:35:11 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d9a901-3f11-4140-aca2-e072642c31ce]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:11 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 Jul 23 10:35:11 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:11 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" returned: 0 in 0.367s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:11 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 Jul 23 10:35:11 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:11 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25" returned: 0 in 0.375s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:11 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25 Jul 23 10:35:11 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:12 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7.1a1708cb-de8f-4328-a5dc-a824562aef25" returned: 0 in 0.277s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-1a1708cb-de8f-4328-a5dc-a824562aef25" released by "_delete_snapshot" :: held 1.505s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" released by "delete_snapshot" :: held 1.530s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:12 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Created reservations ['360b3a79-54b1-4667-8d9d-5d6e864d9c5d', '948debbb-cc73-4fc1-a3aa-b368b57acbbb', '1ee3b67e-930f-43d5-a4dc-e4d0c47b9c62', 'f97688f4-d614-450f-869d-b3702314540b'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:35:12 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Delete snapshot completed successfully. Jul 23 10:35:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c34caeca-cd86-496a-8c23-b92acdcd69fe tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-1a1708cb-de8f-4328-a5dc-a824562aef25-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-91ba16ea-47e5-4af8-b102-3b2a6e409dd7-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-91ba16ea-47e5-4af8-b102-3b2a6e409dd7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" acquired by "delete_volume" :: waited 0.034s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8f225c-b8d4-40b4-bb1e-d43fa7d60aaa]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:13 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 Jul 23 10:35:13 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:13 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" returned: 0 in 0.391s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:13 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7 Jul 23 10:35:13 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:13 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-c868bd5c-1004-4012-be99-ee3373985823 req-58ac756d-ad75-455d-819d-b86a4783c435 tempest-TestMinimumBasicScenario-441670662 None] Terminate volume connection completed successfully. Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-c868bd5c-1004-4012-be99-ee3373985823 req-58ac756d-ad75-455d-819d-b86a4783c435 tempest-TestMinimumBasicScenario-441670662 None] Deleting attachment 3a69baa5-31b4-4d39-bcf5-35ea8383d088. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:35:13 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" returned: 0 in 0.292s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-91ba16ea-47e5-4af8-b102-3b2a6e409dd7" released by "delete_volume" :: held 0.752s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Created reservations ['4136ff5d-5ad2-4294-ac62-55139008e82f', 'e715a755-56ba-4f3a-908f-68f822131562', 'f50484af-5f1d-4f42-8976-f899b1865135', '6f2254e6-a422-4457-b971-099be3477cc8'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:14 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:35:14 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:14 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.249s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:35:14 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Deleted volume successfully. Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ee5b85fd-a03c-4d11-93f0-abc11e6ed82b tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-91ba16ea-47e5-4af8-b102-3b2a6e409dd7-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-af66a6fa-8fc1-4528-9816-4062a31a6112-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-af66a6fa-8fc1-4528-9816-4062a31a6112-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "cinder-quobyte-af66a6fa-8fc1-4528-9816-4062a31a6112" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-af66a6fa-8fc1-4528-9816-4062a31a6112" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b3912c-ef9a-42f1-a48f-8c7ff7a8551d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Acquiring lock "cinder-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Lock "cinder-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Acquiring lock "cinder-quobyte-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Lock "cinder-quobyte-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff904592-c2fc-4e41-9217-240163603639]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:14 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 Jul 23 10:35:14 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:14 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8 Jul 23 10:35:14 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:14 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112" returned: 0 in 0.390s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:14 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112 Jul 23 10:35:14 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:14 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8" returned: 0 in 0.365s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:14 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8 Jul 23 10:35:14 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:15 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-af66a6fa-8fc1-4528-9816-4062a31a6112" returned: 0 in 0.258s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-quobyte-af66a6fa-8fc1-4528-9816-4062a31a6112" released by "delete_volume" :: held 0.708s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Created reservations ['c49e63a8-2766-4366-a5ba-c3419bbaf8c4', 'b0bb4394-a65e-4edf-aec9-c5dc56b8291a', 'f2bc77a6-c186-474d-b8b9-ab237fd7c948', '304c1555-4b64-4757-9c5f-91b69271416b'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:35:15 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8" returned: 0 in 0.247s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Lock "cinder-quobyte-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8" released by "delete_volume" :: held 0.658s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Created reservations ['f7f82786-eba7-4957-bc2e-e7d65672ae8c', 'a3f651c6-e885-4fe5-bb30-840dc2b6d066', '16f9999d-d88e-49f2-981f-c2bac1954161', '03211308-2795-48b1-897a-a6f259cf5d48'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:35:15 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:35:15 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:15 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:35:15 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:15 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:35:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Deleted volume successfully. Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd5d0baf-e8d5-4d94-9976-01ac83ee4931 tempest-VolumesSnapshotTestJSON-1787400501 None] Lock "cinder-af66a6fa-8fc1-4528-9816-4062a31a6112-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:15 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.261s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:35:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Deleted volume successfully. Jul 23 10:35:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-2e36d67f-4817-4b68-9bb4-1b5449ad5089 tempest-TestMinimumBasicScenario-441670662 None] Lock "cinder-3b2ac537-fbe7-45fe-ad3d-f80a85dc5fb8-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:25 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=73,cinder:INSERT=17,cinder:UPDATE=88,cinder:DELETE=10 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:35:25 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=77,cinder:SELECT=77,cinder:DELETE=4,cinder:INSERT=25 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:35:34 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:35:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Flow 'volume_create_manager' (8454ef62-d3ce-44c2-af19-d3e560920d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae12e43c-2e21-423f-a73e-8d58156f1087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae12e43c-2e21-423f-a73e-8d58156f1087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4c4785-af7b-4f4c-b49a-38bb84065e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506798dc8bed4d16858049c4598f31cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:35Z,use_quota=True,user_id='f18ac1d85a4546fcbdfcbbc0007cc2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bc0db75-8841-429e-9539-29cd1205e8a7),volume_type_id=5bc0db75-8841-429e-9539-29cd1205e8a7)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2226451c-11ef-4d1b-89ba-71b40bf2b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2226451c-11ef-4d1b-89ba-71b40bf2b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea7b580-5040-4546-a573-596461b8641b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:34 devstack cinder-volume[88371]: DEBUG cinder.image.glance [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Creating Keystone auth plugin from conf {{(pid=88371) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea7b580-5040-4546-a573-596461b8641b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'df4c4785-af7b-4f4c-b49a-38bb84065e8a', 'volume_name': 'volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a', 'volume_size': 1, 'image_id': '03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e71f50f15a15e4f55f932262de26c26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '506798dc8bed4d16858049c4598f31cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '808d304d7e7b52075863f85aaf96258be4e326520ade037cab2cc6a90b57de1b30155031348969ef86799c6fe814bd5b1161ceabc286e0638419b8bc00850c56', 'id': '03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'created_at': datetime.datetime(2026, 7, 23, 8, 35, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 35, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03ace6b3-12d7-4f62-9d6b-7052be431bd0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53aa079-1ea7-41d3-9c22-15cf91b2345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53aa079-1ea7-41d3-9c22-15cf91b2345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7228406b-36a8-4d9d-b20e-c618d27b2daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:35 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Volume df4c4785-af7b-4f4c-b49a-38bb84065e8a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a', 'volume_size': 1, 'image_id': '03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e71f50f15a15e4f55f932262de26c26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '506798dc8bed4d16858049c4598f31cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '808d304d7e7b52075863f85aaf96258be4e326520ade037cab2cc6a90b57de1b30155031348969ef86799c6fe814bd5b1161ceabc286e0638419b8bc00850c56', 'id': '03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'created_at': datetime.datetime(2026, 7, 23, 8, 35, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 35, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03ace6b3-12d7-4f62-9d6b-7052be431bd0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Trying to clone df4c4785-af7b-4f4c-b49a-38bb84065e8a from image 03ace6b3-12d7-4f62-9d6b-7052be431bd0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'metadata': {}}]). {{(pid=88371) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 10:35:35 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Image download 0.00 MB at 0.00 MB/s Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d206537-4e07-490a-8d2e-4686e38894f0]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:35 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD Jul 23 10:35:35 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:35 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:35 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD Jul 23 10:35:35 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:35 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD" returned: 1 in 0.329s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:35:35 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Temporary image 03ace6b3-12d7-4f62-9d6b-7052be431bd0 is fetched for user f18ac1d85a4546fcbdfcbbc0007cc2b3. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18352f0-87bf-4845-bb6a-91055a11ce6f]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:36 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD Jul 23 10:35:36 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:36 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:36 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD Jul 23 10:35:36 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:36 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4c4785-af7b-4f4c-b49a-38bb84065e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506798dc8bed4d16858049c4598f31cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:35Z,use_quota=True,user_id='f18ac1d85a4546fcbdfcbbc0007cc2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bc0db75-8841-429e-9539-29cd1205e8a7),volume_type_id=5bc0db75-8841-429e-9539-29cd1205e8a7)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Creating volume df4c4785-af7b-4f4c-b49a-38bb84065e8a {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:35:36 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:35:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:36 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a 1073741824 Jul 23 10:35:36 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:37 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a 1073741824" returned: 0 in 0.436s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:37 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a Jul 23 10:35:37 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:37 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:35:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:37 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Attempting download of 03ace6b3-12d7-4f62-9d6b-7052be431bd0 ((None, [{'url': 'file:///opt/stack/data/glance/images/03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'metadata': {}}])) to volume df4c4785-af7b-4f4c-b49a-38bb84065e8a. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 10:35:37 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f12d71a-768a-427d-ba1b-530ebc9a8bbc]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03ace6b3-12d7-4f62-9d6b-7052be431bd0_1v81i5yp {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:37 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03ace6b3-12d7-4f62-9d6b-7052be431bd0_1v81i5yp Jul 23 10:35:37 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:37 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03ace6b3-12d7-4f62-9d6b-7052be431bd0_1v81i5yp" returned: 0 in 0.328s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03ace6b3-12d7-4f62-9d6b-7052be431bd0_1v81i5yp {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:38 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03ace6b3-12d7-4f62-9d6b-7052be431bd0_1v81i5yp Jul 23 10:35:38 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:38 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03ace6b3-12d7-4f62-9d6b-7052be431bd0_1v81i5yp" returned: 1 in 0.317s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03ace6b3-12d7-4f62-9d6b-7052be431bd0_1v81i5yp' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:35:38 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03d2d51-b089-4394-8726-1765b15cc0f1]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:38 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD Jul 23 10:35:38 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:38 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:38 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD Jul 23 10:35:38 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:38 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD" returned: 1 in 0.332s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:35:38 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] 03ace6b3-12d7-4f62-9d6b-7052be431bd0 was raw, converting to qcow2 {{(pid=88371) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 10:35:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:38 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a Jul 23 10:35:38 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:39 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a" returned: 0 in 0.466s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_03ace6b3-12d7-4f62-9d6b-7052be431bd0_y_7o1xc_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:35:39 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:39 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a 1G Jul 23 10:35:39 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:39 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a 1G" returned: 0 in 0.299s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Downloaded image 03ace6b3-12d7-4f62-9d6b-7052be431bd0 ((None, [{'url': 'file:///opt/stack/data/glance/images/03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'metadata': {}}])) to volume df4c4785-af7b-4f4c-b49a-38bb84065e8a successfully. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Temporary image 03ace6b3-12d7-4f62-9d6b-7052be431bd0 for user f18ac1d85a4546fcbdfcbbc0007cc2b3 is deleted. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Marking volume df4c4785-af7b-4f4c-b49a-38bb84065e8a as bootable. {{(pid=88371) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Copying metadata from image 03ace6b3-12d7-4f62-9d6b-7052be431bd0 to df4c4785-af7b-4f4c-b49a-38bb84065e8a. {{(pid=88371) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Creating volume glance metadata for volume df4c4785-af7b-4f4c-b49a-38bb84065e8a backed by image 03ace6b3-12d7-4f62-9d6b-7052be431bd0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4e71f50f15a15e4f55f932262de26c26', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88371) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7228406b-36a8-4d9d-b20e-c618d27b2daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a', 'volume_size': 1, 'image_id': '03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e71f50f15a15e4f55f932262de26c26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '506798dc8bed4d16858049c4598f31cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '808d304d7e7b52075863f85aaf96258be4e326520ade037cab2cc6a90b57de1b30155031348969ef86799c6fe814bd5b1161ceabc286e0638419b8bc00850c56', 'id': '03ace6b3-12d7-4f62-9d6b-7052be431bd0', 'created_at': datetime.datetime(2026, 7, 23, 8, 35, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 35, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03ace6b3-12d7-4f62-9d6b-7052be431bd0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ad1b0d-925f-4654-b7e1-3d96f8e77449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:39 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Volume volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a (df4c4785-af7b-4f4c-b49a-38bb84065e8a): created successfully Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ad1b0d-925f-4654-b7e1-3d96f8e77449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Flow 'volume_create_manager' (8454ef62-d3ce-44c2-af19-d3e560920d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:39 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-73dbd20c-d5e1-4a49-8db4-e93142da08ce tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Created volume successfully. Jul 23 10:35:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Acquiring lock "cinder-df4c4785-af7b-4f4c-b49a-38bb84065e8a-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Lock "cinder-df4c4785-af7b-4f4c-b49a-38bb84065e8a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Acquiring lock "cinder-quobyte-df4c4785-af7b-4f4c-b49a-38bb84065e8a" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Lock "cinder-quobyte-df4c4785-af7b-4f4c-b49a-38bb84065e8a" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:40 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a118a876-50db-454b-ba7f-05ed93146a47]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:40 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a Jul 23 10:35:40 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:40 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a" returned: 0 in 0.399s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:40 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a Jul 23 10:35:40 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:40 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-df4c4785-af7b-4f4c-b49a-38bb84065e8a" returned: 0 in 0.271s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Lock "cinder-quobyte-df4c4785-af7b-4f4c-b49a-38bb84065e8a" released by "delete_volume" :: held 0.724s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:41 devstack cinder-volume[88371]: WARNING cinder.quota [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:35:41 devstack cinder-volume[88371]: WARNING cinder.quota [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 23 10:35:41 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Created reservations ['75c1563e-0d7a-4432-8fb8-58855cfc2522', '62c6c3df-dca9-4bfd-baac-829cdab696a8', '0dbfd8b4-c723-4ee8-b34b-d2911fb5af84', 'faab791c-6a31-4499-9874-353438c98275'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:35:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:41 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:35:41 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:41 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.276s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:41 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:35:41 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Deleted volume successfully. Jul 23 10:35:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aaed66cf-1bce-44ad-b781-3027e5d2ec57 tempest-VolumeAndVolumeTypeFromImageTest-317972177 None] Lock "cinder-df4c4785-af7b-4f4c-b49a-38bb84065e8a-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (5daec916-6f26-4827-a7dd-756470bcd2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a9e921-3362-4e7b-896f-70d862f721a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a9e921-3362-4e7b-896f-70d862f721a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112079064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7eb366-e844-4ba0-af29-0dd3a3a27c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:46Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f149589-8e15-48cd-9dbf-fbe175196f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f149589-8e15-48cd-9dbf-fbe175196f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199c1262-c64d-45d2-a92a-c2d4372fc328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199c1262-c64d-45d2-a92a-c2d4372fc328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd7eb366-e844-4ba0-af29-0dd3a3a27c05', 'volume_name': 'volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4afb4f0-70dc-4b8b-bf52-ab94952abf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4afb4f0-70dc-4b8b-bf52-ab94952abf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3278aebd-d088-461a-998a-aaac29a746db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:46 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume fd7eb366-e844-4ba0-af29-0dd3a3a27c05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05', 'volume_size': 1} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112079064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7eb366-e844-4ba0-af29-0dd3a3a27c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:46Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Creating volume fd7eb366-e844-4ba0-af29-0dd3a3a27c05 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:35:46 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:46 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 1073741824 Jul 23 10:35:46 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:46 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:35:46 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:46 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.287s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:35:46 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 1073741824" returned: 0 in 0.476s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:46 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 Jul 23 10:35:46 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:46 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05" returned: 0 in 0.278s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3278aebd-d088-461a-998a-aaac29a746db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3637a1-321c-4f29-9abd-32750cd4c33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:46 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 (fd7eb366-e844-4ba0-af29-0dd3a3a27c05): created successfully Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3637a1-321c-4f29-9abd-32750cd4c33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (5daec916-6f26-4827-a7dd-756470bcd2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:46 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c0316c60-5483-43ff-ac97-aa210c3c67e6 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created volume successfully. Jul 23 10:35:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Creating offline snapshot 704c09fe-b5c5-4137-b9c0-0c0849690e77 of volume fd7eb366-e844-4ba0-af29-0dd3a3a27c05 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:35:48 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[47729bd0-4269-4d17-92bc-027fc7d05a68]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:48 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 Jul 23 10:35:48 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:48 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05" returned: 0 in 0.482s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:48 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 1G Jul 23 10:35:48 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:49 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 1G" returned: 0 in 0.434s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:49 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 Jul 23 10:35:49 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:49 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77" returned: 0 in 0.301s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:49 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 is being set with open permissions: ugo+rw Jul 23 10:35:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:49 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 Jul 23 10:35:49 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:49 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77" returned: 0 in 0.240s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:49 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.info Jul 23 10:35:49 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:50 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.info" returned: 0 in 0.364s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:50 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.info is being set with open permissions: ugo+rw Jul 23 10:35:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:50 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.info Jul 23 10:35:50 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:50 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.info" returned: 0 in 0.278s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:50 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-469ebb87-b2f2-46ff-a471-02a098c4ca05 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Create snapshot completed successfully Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (b2cc990c-def2-4705-a6db-a625629e0207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c60b48-ffbc-472b-8496-4547e4129eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c60b48-ffbc-472b-8496-4547e4129eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2082255090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd7535a-3197-46c6-950f-84361cc186b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:52Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef792c9-56c3-45fc-8106-3acc41d2a598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef792c9-56c3-45fc-8106-3acc41d2a598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f5a82c-8f37-4760-a92f-90a54db06922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f5a82c-8f37-4760-a92f-90a54db06922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd7535a-3197-46c6-950f-84361cc186b1', 'volume_name': 'volume-4fd7535a-3197-46c6-950f-84361cc186b1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75406385-014c-431e-8ce9-fdcf847613d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75406385-014c-431e-8ce9-fdcf847613d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf392955-a716-433a-8fdf-6ab20117f226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:52 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume 4fd7535a-3197-46c6-950f-84361cc186b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd7535a-3197-46c6-950f-84361cc186b1', 'volume_size': 1} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2082255090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd7535a-3197-46c6-950f-84361cc186b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:52Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Creating volume 4fd7535a-3197-46c6-950f-84361cc186b1 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:35:52 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:52 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1 1073741824 Jul 23 10:35:52 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (820520e6-795b-42c0-a8a8-e7093f411a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc457f8-a542-4fe9-9d70-89f1c561093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc457f8-a542-4fe9-9d70-89f1c561093b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1525153328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27597ca0-765d-44d2-a998-7956fc19d089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:53Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d868d3-eb49-4e4d-97d2-74743d0ffd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d868d3-eb49-4e4d-97d2-74743d0ffd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709eca29-1e0b-498e-9661-655c6a4f68d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709eca29-1e0b-498e-9661-655c6a4f68d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27597ca0-765d-44d2-a998-7956fc19d089', 'volume_name': 'volume-27597ca0-765d-44d2-a998-7956fc19d089', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41be4e94-f125-4997-a2c5-a6ffa07e0eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41be4e94-f125-4997-a2c5-a6ffa07e0eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f939b3-1219-44dd-b391-c9b60995ca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:52 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume 27597ca0-765d-44d2-a998-7956fc19d089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27597ca0-765d-44d2-a998-7956fc19d089', 'volume_size': 1} Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:52 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1 1073741824" returned: 0 in 0.788s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:53 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1 Jul 23 10:35:53 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (1601f77e-6f29-415d-9b02-0a6e8d666ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfefcf62-a628-4372-814e-8c9b0514a07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfefcf62-a628-4372-814e-8c9b0514a07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-834988668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e3deff-1f28-48c9-bd5e-c7900ad47699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:53Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee429941-8ebd-414b-b264-af18e297e0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee429941-8ebd-414b-b264-af18e297e0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6b2106-3951-414c-9a69-8794357ccbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6b2106-3951-414c-9a69-8794357ccbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e3deff-1f28-48c9-bd5e-c7900ad47699', 'volume_name': 'volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effac9bb-a605-4687-b0d1-ef1fb008244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effac9bb-a605-4687-b0d1-ef1fb008244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329b884f-1ec4-49e3-abf1-365d45cee948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:53 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume f6e3deff-1f28-48c9-bd5e-c7900ad47699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699', 'volume_size': 1} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:53 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1" returned: 0 in 0.460s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.583s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1525153328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27597ca0-765d-44d2-a998-7956fc19d089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:53Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Creating volume 27597ca0-765d-44d2-a998-7956fc19d089 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:35:53 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:53 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089 1073741824 Jul 23 10:35:53 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf392955-a716-433a-8fdf-6ab20117f226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd7535a-3197-46c6-950f-84361cc186b1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc84e1f9-233d-4ef7-8840-0e53ca15d639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:53 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume volume-4fd7535a-3197-46c6-950f-84361cc186b1 (4fd7535a-3197-46c6-950f-84361cc186b1): created successfully Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc84e1f9-233d-4ef7-8840-0e53ca15d639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (b2cc990c-def2-4705-a6db-a625629e0207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5cabc0b7-ed47-485e-a7e1-036c6168d0c7 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created volume successfully. Jul 23 10:35:53 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (86c63751-9187-4672-b8de-9d137e5e8fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fbf986-997a-4d9e-8e85-413b3a117aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fbf986-997a-4d9e-8e85-413b3a117aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-765062972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e091f96-f750-4781-9b76-0516f21f6e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:54Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3e9bdf-0696-4908-a877-07be773b2240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3e9bdf-0696-4908-a877-07be773b2240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7203e53d-9ca1-4f40-accc-914026b5ec6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7203e53d-9ca1-4f40-accc-914026b5ec6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e091f96-f750-4781-9b76-0516f21f6e56', 'volume_name': 'volume-4e091f96-f750-4781-9b76-0516f21f6e56', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6aa2934-441f-4b27-bdc1-8b8088fd6385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6aa2934-441f-4b27-bdc1-8b8088fd6385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e657d2-a0b6-4d0a-911c-a29c2eb7df57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:54 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume 4e091f96-f750-4781-9b76-0516f21f6e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e091f96-f750-4781-9b76-0516f21f6e56', 'volume_size': 1} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:54 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089 1073741824" returned: 0 in 0.742s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:54 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089 Jul 23 10:35:54 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (b4bfa749-843e-4b59-a567-69714eaa9d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7d6d0e-9044-42e5-a71f-20a6cbb91021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7d6d0e-9044-42e5-a71f-20a6cbb91021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1400953510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790b3c78-1800-452a-b5d7-09435c2a1081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:54Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83f1fcd-26aa-42d8-9023-f361a8a518e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83f1fcd-26aa-42d8-9023-f361a8a518e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44866aa2-b041-4132-959f-b1f791f01309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44866aa2-b041-4132-959f-b1f791f01309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790b3c78-1800-452a-b5d7-09435c2a1081', 'volume_name': 'volume-790b3c78-1800-452a-b5d7-09435c2a1081', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee09f940-b539-4a5d-b087-882365ecad6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee09f940-b539-4a5d-b087-882365ecad6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acde33c-afe5-413e-98bb-2b2700a37705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:54 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume 790b3c78-1800-452a-b5d7-09435c2a1081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790b3c78-1800-452a-b5d7-09435c2a1081', 'volume_size': 1} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:54 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089" returned: 0 in 0.280s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-834988668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e3deff-1f28-48c9-bd5e-c7900ad47699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:53Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Creating volume f6e3deff-1f28-48c9-bd5e-c7900ad47699 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:35:54 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f939b3-1219-44dd-b391-c9b60995ca03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27597ca0-765d-44d2-a998-7956fc19d089', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce64595-6f9b-4e60-a2a1-01e3f8aaf732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:54 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699 1073741824 Jul 23 10:35:54 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:54 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume volume-27597ca0-765d-44d2-a998-7956fc19d089 (27597ca0-765d-44d2-a998-7956fc19d089): created successfully Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce64595-6f9b-4e60-a2a1-01e3f8aaf732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (820520e6-795b-42c0-a8a8-e7093f411a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:54 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-977db2b8-abaa-4fa0-9e1b-d9fc0ab8d89c tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created volume successfully. Jul 23 10:35:55 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699 1073741824" returned: 0 in 0.425s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:55 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699 Jul 23 10:35:55 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:55 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.201s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-765062972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e091f96-f750-4781-9b76-0516f21f6e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:54Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Creating volume 4e091f96-f750-4781-9b76-0516f21f6e56 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:35:55 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329b884f-1ec4-49e3-abf1-365d45cee948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:55 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56 1073741824 Jul 23 10:35:55 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96c02ce-bb3e-45ec-af79-a6996fa7b67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:55 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699 (f6e3deff-1f28-48c9-bd5e-c7900ad47699): created successfully Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96c02ce-bb3e-45ec-af79-a6996fa7b67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (1601f77e-6f29-415d-9b02-0a6e8d666ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-38c09284-d6fc-47af-bfb8-2fb4fe1f13be tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created volume successfully. Jul 23 10:35:55 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56 1073741824" returned: 0 in 0.463s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:55 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56 Jul 23 10:35:55 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:56 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56" returned: 0 in 0.259s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1400953510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790b3c78-1800-452a-b5d7-09435c2a1081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3008087774b81beced9ddf4a12c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:35:54Z,use_quota=True,user_id='48305f6a9d22422d86c74430a47bab62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Creating volume 790b3c78-1800-452a-b5d7-09435c2a1081 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:35:56 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e657d2-a0b6-4d0a-911c-a29c2eb7df57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e091f96-f750-4781-9b76-0516f21f6e56', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:56 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081 1073741824 Jul 23 10:35:56 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9f2ba8-07e1-4ef9-b502-7ca68ffb468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:56 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume volume-4e091f96-f750-4781-9b76-0516f21f6e56 (4e091f96-f750-4781-9b76-0516f21f6e56): created successfully Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9f2ba8-07e1-4ef9-b502-7ca68ffb468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (86c63751-9187-4672-b8de-9d137e5e8fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:56 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-36697319-c4bc-453d-871f-1be0ca87c0e1 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created volume successfully. Jul 23 10:35:56 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081 1073741824" returned: 0 in 0.450s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:56 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081 Jul 23 10:35:56 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:56 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081" returned: 0 in 0.260s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acde33c-afe5-413e-98bb-2b2700a37705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790b3c78-1800-452a-b5d7-09435c2a1081', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf316e7-0a4f-46ff-8997-9bbe1e07068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:35:56 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Volume volume-790b3c78-1800-452a-b5d7-09435c2a1081 (790b3c78-1800-452a-b5d7-09435c2a1081): created successfully Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf316e7-0a4f-46ff-8997-9bbe1e07068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:35:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Flow 'volume_create_manager' (b4bfa749-843e-4b59-a567-69714eaa9d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:35:56 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-18045135-6f91-4201-bb8e-c45228be1c03 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created volume successfully. Jul 23 10:35:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-790b3c78-1800-452a-b5d7-09435c2a1081-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-790b3c78-1800-452a-b5d7-09435c2a1081-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-quobyte-790b3c78-1800-452a-b5d7-09435c2a1081" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-790b3c78-1800-452a-b5d7-09435c2a1081" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:57 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e65a76-f47c-4480-a0bc-beb54e8a3b99]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:58 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081 Jul 23 10:35:58 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:58 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081" returned: 0 in 0.372s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:58 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081 Jul 23 10:35:58 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:58 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-790b3c78-1800-452a-b5d7-09435c2a1081" returned: 0 in 0.254s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-790b3c78-1800-452a-b5d7-09435c2a1081" released by "delete_volume" :: held 0.667s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:58 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created reservations ['016f2258-a633-432c-8795-3eb0d251b25f', '72a69142-555c-49c6-92f3-d4aea4314797', '921bdef9-dd9c-4d72-9ada-3fb7bbabe81f', '0f2fb817-62af-47f3-aeff-dcb73c993950'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:35:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:58 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:35:58 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:59 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.308s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:35:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Deleted volume successfully. Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-17593bdf-e0ae-4115-a773-f5d66f574313 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-790b3c78-1800-452a-b5d7-09435c2a1081-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-4e091f96-f750-4781-9b76-0516f21f6e56-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-4e091f96-f750-4781-9b76-0516f21f6e56-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-quobyte-4e091f96-f750-4781-9b76-0516f21f6e56" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-4e091f96-f750-4781-9b76-0516f21f6e56" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8398353-623f-401a-a02e-6eef12a0e24a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:59 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56 Jul 23 10:35:59 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:59 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56" returned: 0 in 0.361s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:59 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56 Jul 23 10:35:59 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:35:59 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4e091f96-f750-4781-9b76-0516f21f6e56" returned: 0 in 0.276s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-4e091f96-f750-4781-9b76-0516f21f6e56" released by "delete_volume" :: held 0.680s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created reservations ['6bd59c29-a73b-4564-abbf-23397f503f92', '6e8f8d69-4b4f-4f63-a58f-3ad12d6a55d3', '1bf3d932-c48d-4d39-85a8-f9ca9608e70d', 'dde95719-9ea4-4957-81a1-2c4bdcef0e47'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:35:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:35:59 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:35:59 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:00 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:00 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Deleted volume successfully. Jul 23 10:36:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-59091bed-aae7-4371-81f0-52f8ebf06717 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-4e091f96-f750-4781-9b76-0516f21f6e56-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-f6e3deff-1f28-48c9-bd5e-c7900ad47699-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-f6e3deff-1f28-48c9-bd5e-c7900ad47699-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-quobyte-f6e3deff-1f28-48c9-bd5e-c7900ad47699" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-f6e3deff-1f28-48c9-bd5e-c7900ad47699" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:00 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83a4ac2-1bcf-4c1f-92b0-de9c701f32f7]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:00 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699 Jul 23 10:36:00 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:00 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699" returned: 0 in 0.368s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:00 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699 Jul 23 10:36:00 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:01 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f6e3deff-1f28-48c9-bd5e-c7900ad47699" returned: 0 in 0.280s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-f6e3deff-1f28-48c9-bd5e-c7900ad47699" released by "delete_volume" :: held 0.696s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created reservations ['857abb19-43cb-48c7-b8ba-af9e9bd00934', '6ebfefc9-b26e-47b6-95af-156ab8e98c7a', '9975b7a5-a893-4aeb-8134-5e83a3e975ad', 'aaac3af7-8e01-4e97-9bab-e48f91783735'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:01 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:01 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-27597ca0-765d-44d2-a998-7956fc19d089-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-27597ca0-765d-44d2-a998-7956fc19d089-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:01 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.319s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Deleted volume successfully. Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-3d656157-af1b-40cb-9860-1306ac90d1bf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-f6e3deff-1f28-48c9-bd5e-c7900ad47699-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-quobyte-27597ca0-765d-44d2-a998-7956fc19d089" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-27597ca0-765d-44d2-a998-7956fc19d089" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[61348640-b597-4ac6-bc54-63b87c994edf]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:01 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089 Jul 23 10:36:01 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:02 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089" returned: 0 in 0.410s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:02 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089 Jul 23 10:36:02 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:02 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-27597ca0-765d-44d2-a998-7956fc19d089" returned: 0 in 0.269s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-27597ca0-765d-44d2-a998-7956fc19d089" released by "delete_volume" :: held 0.725s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created reservations ['f6390758-db22-4b78-8241-449836baee79', '948f8df0-97ae-4e6d-a0b6-9d00f5b3fe75', '59811798-c1d2-4cb8-b457-596cabc5f054', '5064fd46-9f1e-4591-ba29-ac029d03b37c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:02 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:02 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-4fd7535a-3197-46c6-950f-84361cc186b1-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-4fd7535a-3197-46c6-950f-84361cc186b1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-quobyte-4fd7535a-3197-46c6-950f-84361cc186b1" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:02 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.279s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:02 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Deleted volume successfully. Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-4fd7535a-3197-46c6-950f-84361cc186b1" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b71ef2b-d478-4299-a9f4-b29490b4cdfe]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-00ee7e3f-f6be-471b-b586-61b004b76434 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-27597ca0-765d-44d2-a998-7956fc19d089-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:02 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1 Jul 23 10:36:02 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:03 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1" returned: 0 in 0.361s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:03 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1 Jul 23 10:36:03 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:03 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-4fd7535a-3197-46c6-950f-84361cc186b1" returned: 0 in 0.242s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-4fd7535a-3197-46c6-950f-84361cc186b1" released by "delete_volume" :: held 0.641s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created reservations ['ad96c266-b831-4656-ae72-c5430e4f4864', '690d8c41-3368-445f-b5d4-ce4f2f1aa909', '3365a223-4781-4d58-ac17-84fb56dd94e4', '2ab3ff02-fcff-4558-a56f-64d2702e690c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:03 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:03 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:03 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.243s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:03 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Deleted volume successfully. Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-48703c21-5305-453d-a2c5-db94529c60cf tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-4fd7535a-3197-46c6-950f-84361cc186b1-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-704c09fe-b5c5-4137-b9c0-0c0849690e77-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-704c09fe-b5c5-4137-b9c0-0c0849690e77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-quobyte-fd7eb366-e844-4ba0-af29-0dd3a3a27c05" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-fd7eb366-e844-4ba0-af29-0dd3a3a27c05" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-quobyte-704c09fe-b5c5-4137-b9c0-0c0849690e77" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-704c09fe-b5c5-4137-b9c0-0c0849690e77" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Deleting offline snapshot 704c09fe-b5c5-4137-b9c0-0c0849690e77 of volume fd7eb366-e844-4ba0-af29-0dd3a3a27c05 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] snapshot_file for this snap is: volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc737d28-8ef2-479b-9ea0-0c6262d997ed]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:04 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 Jul 23 10:36:04 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:04 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77" returned: 0 in 0.337s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:36:04 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c9e725-4e17-4eb5-b949-2637394b053b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:04 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 Jul 23 10:36:04 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:04 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05" returned: 0 in 0.342s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:04 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 Jul 23 10:36:04 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:04 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77" returned: 0 in 0.326s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:04 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77 Jul 23 10:36:04 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:05 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05.704c09fe-b5c5-4137-b9c0-0c0849690e77" returned: 0 in 0.232s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-704c09fe-b5c5-4137-b9c0-0c0849690e77" released by "_delete_snapshot" :: held 1.330s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-fd7eb366-e844-4ba0-af29-0dd3a3a27c05" released by "delete_snapshot" :: held 1.350s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:05 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created reservations ['5f680b65-11d4-4ab5-abf9-f1835d20fa33', 'e5070cac-3cc2-4210-ba08-22ad59580ce8', '76518bc0-07e6-4231-a678-31efd14a1528', 'c6d29cb5-5034-486d-b16a-930d23cbfdd6'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:05 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Delete snapshot completed successfully. Jul 23 10:36:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b9d888ed-9c14-412a-846c-527611fbc7a0 tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-704c09fe-b5c5-4137-b9c0-0c0849690e77-delete_snapshot" released by "delete_snapshot" :: held 1.472s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-fd7eb366-e844-4ba0-af29-0dd3a3a27c05-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-fd7eb366-e844-4ba0-af29-0dd3a3a27c05-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "cinder-quobyte-fd7eb366-e844-4ba0-af29-0dd3a3a27c05" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-fd7eb366-e844-4ba0-af29-0dd3a3a27c05" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[589998d8-8500-4bbc-90e9-84770fd4846d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:06 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 Jul 23 10:36:06 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:06 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05" returned: 0 in 0.341s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:06 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05 Jul 23 10:36:06 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:06 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fd7eb366-e844-4ba0-af29-0dd3a3a27c05" returned: 0 in 0.233s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-quobyte-fd7eb366-e844-4ba0-af29-0dd3a3a27c05" released by "delete_volume" :: held 0.627s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Created reservations ['06f8e79b-0707-4d1b-a20e-ba9d6e979b69', '943a42d5-bb26-4cb1-80f2-ca84ad9eacef', '45178ed7-6e57-430c-b6ec-dfa9bb0c6f73', 'ac7153a9-25a4-486e-87b0-247e0dcc0dcb'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:06 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:06 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:07 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.239s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:07 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Deleted volume successfully. Jul 23 10:36:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b952154b-bda3-48cc-80fa-d1eaeddb053b tempest-CreateVolumesFromSnapshotTest-2049202704 None] Lock "cinder-fd7eb366-e844-4ba0-af29-0dd3a3a27c05-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Flow 'volume_create_manager' (d298116c-91da-48af-a45e-d40b1b4a3b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d7f283-4ba7-4211-af73-0fe863d866cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d7f283-4ba7-4211-af73-0fe863d866cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1121420632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912131ad-3425-4b6c-8608-283c18d66feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647cf7eb86bf4e5381f7833a3479a3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:14Z,use_quota=True,user_id='ee2b649601a347a780ae5a50f9b390e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99ff1c1-a3bc-494d-a102-18edf915c30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99ff1c1-a3bc-494d-a102-18edf915c30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297d2720-8541-4de7-93e0-27e9c305ae0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297d2720-8541-4de7-93e0-27e9c305ae0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912131ad-3425-4b6c-8608-283c18d66feb', 'volume_name': 'volume-912131ad-3425-4b6c-8608-283c18d66feb', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c09ab03-18ef-4ec8-a886-eae6ea78bf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c09ab03-18ef-4ec8-a886-eae6ea78bf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67849ff6-2172-4f44-bc2c-9c355f308771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:13 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Volume 912131ad-3425-4b6c-8608-283c18d66feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912131ad-3425-4b6c-8608-283c18d66feb', 'volume_size': 1} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1121420632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912131ad-3425-4b6c-8608-283c18d66feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647cf7eb86bf4e5381f7833a3479a3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:14Z,use_quota=True,user_id='ee2b649601a347a780ae5a50f9b390e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Creating volume 912131ad-3425-4b6c-8608-283c18d66feb {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:13 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:13 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb 1073741824 Jul 23 10:36:13 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:14 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb 1073741824" returned: 0 in 0.405s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:14 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb Jul 23 10:36:14 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:14 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb" returned: 0 in 0.245s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67849ff6-2172-4f44-bc2c-9c355f308771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912131ad-3425-4b6c-8608-283c18d66feb', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c17831-3a12-413a-b1e6-612bf2b551e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:14 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Volume volume-912131ad-3425-4b6c-8608-283c18d66feb (912131ad-3425-4b6c-8608-283c18d66feb): created successfully Jul 23 10:36:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c17831-3a12-413a-b1e6-612bf2b551e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Flow 'volume_create_manager' (d298116c-91da-48af-a45e-d40b1b4a3b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:14 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-60ac1751-f4dd-4cbe-aa97-1fbe5bc4d569 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Created volume successfully. Jul 23 10:36:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-b816253e-b75e-4b00-bc7c-4165e15cfafc req-095ab92c-4af4-4bd7-a57b-92378865642f tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-b816253e-b75e-4b00-bc7c-4165e15cfafc req-095ab92c-4af4-4bd7-a57b-92378865642f tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [req-b816253e-b75e-4b00-bc7c-4165e15cfafc req-095ab92c-4af4-4bd7-a57b-92378865642f tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-b816253e-b75e-4b00-bc7c-4165e15cfafc req-095ab92c-4af4-4bd7-a57b-92378865642f tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377', 'name': 'volume-912131ad-3425-4b6c-8608-283c18d66feb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5846da5-9640-44a4-b661-523d468c2ffb', 'enforce_multipath': True} {{(pid=88371) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 10:36:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-b816253e-b75e-4b00-bc7c-4165e15cfafc req-095ab92c-4af4-4bd7-a57b-92378865642f tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] attachment_update completed successfully. Jul 23 10:36:18 devstack cinder-volume[88371]: INFO cinder.volume.manager [req-96f68ba2-4c22-40a6-b360-d6bc6309f740 req-78af6d4a-8df8-438f-b18f-69c959dcb326 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Terminate volume connection completed successfully. Jul 23 10:36:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [req-96f68ba2-4c22-40a6-b360-d6bc6309f740 req-78af6d4a-8df8-438f-b18f-69c959dcb326 tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Deleting attachment b5846da5-9640-44a4-b661-523d468c2ffb. {{(pid=88371) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 10:36:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Acquiring lock "cinder-912131ad-3425-4b6c-8608-283c18d66feb-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "cinder-912131ad-3425-4b6c-8608-283c18d66feb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Acquiring lock "cinder-quobyte-912131ad-3425-4b6c-8608-283c18d66feb" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "cinder-quobyte-912131ad-3425-4b6c-8608-283c18d66feb" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:19 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[24888fad-6947-46ee-93fe-3894a0d8ff04]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:19 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb Jul 23 10:36:19 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:19 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb" returned: 0 in 0.360s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:19 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb Jul 23 10:36:19 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:20 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-912131ad-3425-4b6c-8608-283c18d66feb" returned: 0 in 0.257s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "cinder-quobyte-912131ad-3425-4b6c-8608-283c18d66feb" released by "delete_volume" :: held 0.657s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Created reservations ['d2ca7d99-7c52-4c94-ab94-89172e01bb4b', '7ddfdafa-995f-45e9-bf8e-271b8d9f9675', '4d610742-2fc9-4ea5-a0c3-aed78c562c58', 'a390a33f-58f4-4834-ac66-304190958b12'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:20 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:20 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:20 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.240s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:20 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Deleted volume successfully. Jul 23 10:36:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-720572b4-fe7f-4ebf-946c-0b713302319d tempest-TestServerVolumeAttachScenarioOldVersion-788310469 None] Lock "cinder-912131ad-3425-4b6c-8608-283c18d66feb-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:30 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=79,cinder:UPDATE=101,cinder:INSERT=22,cinder:DELETE=8 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:36:30 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=95,cinder:SELECT=78,cinder:INSERT=33,cinder:DELETE=9 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Flow 'volume_create_manager' (5d8517e8-2f07-4097-81ad-09f635f163be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02417f6-5a10-4bec-8f5e-43e8410d1581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02417f6-5a10-4bec-8f5e-43e8410d1581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2083923043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a0fba3-48fb-458b-ae4f-acf851fb7730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04ede69784b4d86bc63b45511f531d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:34Z,use_quota=True,user_id='e055108c65cf477d9c24af99f38c680c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd04c64e-fb5f-439a-a310-c98cb5d3fa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd04c64e-fb5f-439a-a310-c98cb5d3fa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614425a8-a11c-4642-9646-012b92b7e022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614425a8-a11c-4642-9646-012b92b7e022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a0fba3-48fb-458b-ae4f-acf851fb7730', 'volume_name': 'volume-46a0fba3-48fb-458b-ae4f-acf851fb7730', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e436079b-a271-4f96-8f08-4545abe0eadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e436079b-a271-4f96-8f08-4545abe0eadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45744540-f10c-45ab-ae91-c5e613f202ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:33 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Volume 46a0fba3-48fb-458b-ae4f-acf851fb7730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a0fba3-48fb-458b-ae4f-acf851fb7730', 'volume_size': 1} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2083923043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a0fba3-48fb-458b-ae4f-acf851fb7730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04ede69784b4d86bc63b45511f531d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:34Z,use_quota=True,user_id='e055108c65cf477d9c24af99f38c680c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Creating volume 46a0fba3-48fb-458b-ae4f-acf851fb7730 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:33 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:33 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730 1073741824 Jul 23 10:36:33 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Flow 'volume_create_manager' (5bafc9a8-be77-4669-8a0c-56766726b6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7464d7-5e67-447d-9bc9-dfa471b3ecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7464d7-5e67-447d-9bc9-dfa471b3ecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2021528419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b7cf1e-255c-4357-814c-4be9729bebc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04ede69784b4d86bc63b45511f531d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:34Z,use_quota=True,user_id='e055108c65cf477d9c24af99f38c680c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d00e9a-e663-490b-b40a-dd3993404a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d00e9a-e663-490b-b40a-dd3993404a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e474efcb-e763-470b-9464-bf4e9036076a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e474efcb-e763-470b-9464-bf4e9036076a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b7cf1e-255c-4357-814c-4be9729bebc7', 'volume_name': 'volume-29b7cf1e-255c-4357-814c-4be9729bebc7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3c3355-3097-4829-95e1-acec5303c71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3c3355-3097-4829-95e1-acec5303c71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eeb1a16-c043-438e-920c-27e8c366cc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Volume 29b7cf1e-255c-4357-814c-4be9729bebc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b7cf1e-255c-4357-814c-4be9729bebc7', 'volume_size': 1} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:34 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730 1073741824" returned: 0 in 0.491s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:34 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730 Jul 23 10:36:34 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Flow 'volume_create_manager' (eff972f1-9537-4192-801b-c35f7e3d9b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f68d3e3-3b96-45e7-811a-838abf71edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f68d3e3-3b96-45e7-811a-838abf71edbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810645619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b08cbb-845d-4c79-9969-fa4b580cc98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04ede69784b4d86bc63b45511f531d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:34Z,use_quota=True,user_id='e055108c65cf477d9c24af99f38c680c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179fec61-4814-43a6-84f9-e17e778f7b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179fec61-4814-43a6-84f9-e17e778f7b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8b259c-3509-46d8-ae29-a6e610546ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8b259c-3509-46d8-ae29-a6e610546ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8b08cbb-845d-4c79-9969-fa4b580cc98a', 'volume_name': 'volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf88bd1-ee2d-4f2f-a6a3-42f02d75e056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf88bd1-ee2d-4f2f-a6a3-42f02d75e056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99e4695-2b09-467e-a130-e7cc3f370ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Volume f8b08cbb-845d-4c79-9969-fa4b580cc98a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a', 'volume_size': 1} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:34 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730" returned: 0 in 0.256s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2021528419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b7cf1e-255c-4357-814c-4be9729bebc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04ede69784b4d86bc63b45511f531d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:34Z,use_quota=True,user_id='e055108c65cf477d9c24af99f38c680c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Creating volume 29b7cf1e-255c-4357-814c-4be9729bebc7 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:34 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:34 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7 1073741824 Jul 23 10:36:34 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45744540-f10c-45ab-ae91-c5e613f202ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a0fba3-48fb-458b-ae4f-acf851fb7730', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4b4816-cca8-4b05-be85-7f62db142bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Volume volume-46a0fba3-48fb-458b-ae4f-acf851fb7730 (46a0fba3-48fb-458b-ae4f-acf851fb7730): created successfully Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4b4816-cca8-4b05-be85-7f62db142bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Flow 'volume_create_manager' (5d8517e8-2f07-4097-81ad-09f635f163be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:34 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-15527e3e-6c03-41fc-a134-d7775eab297b tempest-CreateVolumesFromImageTest-1126454937 None] Created volume successfully. Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Flow 'volume_create_manager' (3d5e9b85-aecd-4d48-ba90-d10f378b210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c80b3d3-ba84-4fb0-b7a4-561ca2c4a072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c80b3d3-ba84-4fb0-b7a4-561ca2c4a072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1649452290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07275acd-6c91-4622-ab0f-04d5bcf9543a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04ede69784b4d86bc63b45511f531d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:35Z,use_quota=True,user_id='e055108c65cf477d9c24af99f38c680c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dec01a8-7cfb-4132-9371-cff480d70df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dec01a8-7cfb-4132-9371-cff480d70df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e35a72a-c9ab-400e-b5a5-234965433e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e35a72a-c9ab-400e-b5a5-234965433e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07275acd-6c91-4622-ab0f-04d5bcf9543a', 'volume_name': 'volume-07275acd-6c91-4622-ab0f-04d5bcf9543a', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d80d3db-891f-44a6-8df5-8d1eafa17a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d80d3db-891f-44a6-8df5-8d1eafa17a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604cc810-cc83-42b6-a031-e4215e127fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:34 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Volume 07275acd-6c91-4622-ab0f-04d5bcf9543a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07275acd-6c91-4622-ab0f-04d5bcf9543a', 'volume_size': 1} Jul 23 10:36:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:35 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7 1073741824" returned: 0 in 0.522s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:35 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7 Jul 23 10:36:35 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Flow 'volume_create_manager' (ac264867-3a88-4a6b-812e-26fe485ee280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc8abf5-80f9-46a5-945d-3500815e75f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc8abf5-80f9-46a5-945d-3500815e75f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1497173752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4290ada-d884-41e9-be98-1b7eedd64272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04ede69784b4d86bc63b45511f531d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:35Z,use_quota=True,user_id='e055108c65cf477d9c24af99f38c680c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f057fca8-c422-4aa7-8976-fec475bed54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f057fca8-c422-4aa7-8976-fec475bed54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbc6e47-5252-4b9f-ab26-2e96f3b62761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbc6e47-5252-4b9f-ab26-2e96f3b62761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4290ada-d884-41e9-be98-1b7eedd64272', 'volume_name': 'volume-c4290ada-d884-41e9-be98-1b7eedd64272', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8339e36b-c1c0-46a3-a04f-4bb7a26dc301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8339e36b-c1c0-46a3-a04f-4bb7a26dc301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52f5200-b183-4d61-a917-f3ee483d31d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:35 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Volume c4290ada-d884-41e9-be98-1b7eedd64272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4290ada-d884-41e9-be98-1b7eedd64272', 'volume_size': 1} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:35 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7" returned: 0 in 0.249s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810645619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b08cbb-845d-4c79-9969-fa4b580cc98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04ede69784b4d86bc63b45511f531d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:34Z,use_quota=True,user_id='e055108c65cf477d9c24af99f38c680c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Creating volume f8b08cbb-845d-4c79-9969-fa4b580cc98a {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:35 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eeb1a16-c043-438e-920c-27e8c366cc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b7cf1e-255c-4357-814c-4be9729bebc7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:35 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a 1073741824 Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae12457-5492-40d8-9d5f-b904ef23c961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:35 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:35 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Volume volume-29b7cf1e-255c-4357-814c-4be9729bebc7 (29b7cf1e-255c-4357-814c-4be9729bebc7): created successfully Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae12457-5492-40d8-9d5f-b904ef23c961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Flow 'volume_create_manager' (5bafc9a8-be77-4669-8a0c-56766726b6a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:35 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1230d12d-3e6e-498d-a03c-2dabf929332c tempest-CreateVolumesFromImageTest-1126454937 None] Created volume successfully. Jul 23 10:36:35 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a 1073741824" returned: 0 in 0.409s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:35 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a Jul 23 10:36:35 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:36 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a" returned: 0 in 0.244s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.186s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1649452290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07275acd-6c91-4622-ab0f-04d5bcf9543a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04ede69784b4d86bc63b45511f531d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:35Z,use_quota=True,user_id='e055108c65cf477d9c24af99f38c680c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Creating volume 07275acd-6c91-4622-ab0f-04d5bcf9543a {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:36 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99e4695-2b09-467e-a130-e7cc3f370ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdf3057-ced2-4db7-81d7-3691749ce676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:36 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a 1073741824 Jul 23 10:36:36 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:36 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Volume volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a (f8b08cbb-845d-4c79-9969-fa4b580cc98a): created successfully Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdf3057-ced2-4db7-81d7-3691749ce676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Flow 'volume_create_manager' (eff972f1-9537-4192-801b-c35f7e3d9b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:36 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-39ba6665-8bed-4ac6-ab98-bd3b25e2973a tempest-CreateVolumesFromImageTest-1126454937 None] Created volume successfully. Jul 23 10:36:36 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a 1073741824" returned: 0 in 0.450s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:36 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a Jul 23 10:36:36 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:36 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a" returned: 0 in 0.234s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1497173752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4290ada-d884-41e9-be98-1b7eedd64272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04ede69784b4d86bc63b45511f531d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:35Z,use_quota=True,user_id='e055108c65cf477d9c24af99f38c680c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Creating volume c4290ada-d884-41e9-be98-1b7eedd64272 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:36 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604cc810-cc83-42b6-a031-e4215e127fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07275acd-6c91-4622-ab0f-04d5bcf9543a', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:36 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272 1073741824 Jul 23 10:36:36 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1449cd76-b41f-4d98-b916-baacf8e396cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:36 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Volume volume-07275acd-6c91-4622-ab0f-04d5bcf9543a (07275acd-6c91-4622-ab0f-04d5bcf9543a): created successfully Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1449cd76-b41f-4d98-b916-baacf8e396cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Flow 'volume_create_manager' (3d5e9b85-aecd-4d48-ba90-d10f378b210e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:36 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6ed72fe1-348a-4e51-97d9-9f7ba5fe5f1c tempest-CreateVolumesFromImageTest-1126454937 None] Created volume successfully. Jul 23 10:36:37 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272 1073741824" returned: 0 in 0.410s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:37 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272 Jul 23 10:36:37 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:37 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272" returned: 0 in 0.243s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52f5200-b183-4d61-a917-f3ee483d31d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4290ada-d884-41e9-be98-1b7eedd64272', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109198c4-3072-4f03-9df0-a14fd0b8600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:37 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Volume volume-c4290ada-d884-41e9-be98-1b7eedd64272 (c4290ada-d884-41e9-be98-1b7eedd64272): created successfully Jul 23 10:36:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109198c4-3072-4f03-9df0-a14fd0b8600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Flow 'volume_create_manager' (ac264867-3a88-4a6b-812e-26fe485ee280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:37 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-586100c7-cf91-4b85-a464-c962c2732763 tempest-CreateVolumesFromImageTest-1126454937 None] Created volume successfully. Jul 23 10:36:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "cinder-c4290ada-d884-41e9-be98-1b7eedd64272-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-c4290ada-d884-41e9-be98-1b7eedd64272-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "cinder-quobyte-c4290ada-d884-41e9-be98-1b7eedd64272" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:38 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-quobyte-c4290ada-d884-41e9-be98-1b7eedd64272" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:38 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd6be00-ab47-4db8-a68a-017bfff55d3a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:38 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272 Jul 23 10:36:38 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:38 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272" returned: 0 in 0.361s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:39 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272 Jul 23 10:36:39 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:39 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c4290ada-d884-41e9-be98-1b7eedd64272" returned: 0 in 0.242s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-quobyte-c4290ada-d884-41e9-be98-1b7eedd64272" released by "delete_volume" :: held 0.638s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Created reservations ['1abd8c5e-0182-4877-8edf-4eacaa61c724', 'e2ccf696-be2d-4dca-894b-a01f4fe9d09f', 'a1f2c34a-7610-4e07-a13e-763c6b4d40a8', 'e0545cb6-f2dc-4929-b0e9-a99695e4194a'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:39 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:39 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:39 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.248s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:39 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Deleted volume successfully. Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-25d96f46-73af-4632-9aeb-b17f0ac79a6f tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-c4290ada-d884-41e9-be98-1b7eedd64272-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "cinder-07275acd-6c91-4622-ab0f-04d5bcf9543a-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-07275acd-6c91-4622-ab0f-04d5bcf9543a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "cinder-quobyte-07275acd-6c91-4622-ab0f-04d5bcf9543a" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-quobyte-07275acd-6c91-4622-ab0f-04d5bcf9543a" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd3d0ac-434b-47e2-9451-df759c4c42d1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:39 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a Jul 23 10:36:39 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:40 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a" returned: 0 in 0.354s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:40 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a Jul 23 10:36:40 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:40 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-07275acd-6c91-4622-ab0f-04d5bcf9543a" returned: 0 in 0.244s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-quobyte-07275acd-6c91-4622-ab0f-04d5bcf9543a" released by "delete_volume" :: held 0.640s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Created reservations ['986f5dd9-4c3c-4c0b-8257-adb15f74830a', '3e8f28cb-847c-43f2-8e7b-398470e8723a', '225cb769-9a31-450a-95f3-be844087de97', '75fdba6a-c1fc-41fe-83f9-5fd2c37df027'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:40 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:40 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:40 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.234s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:40 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Deleted volume successfully. Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fb15ce71-c8cd-4392-8fbf-bffde4f8b73c tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-07275acd-6c91-4622-ab0f-04d5bcf9543a-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "cinder-f8b08cbb-845d-4c79-9969-fa4b580cc98a-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-f8b08cbb-845d-4c79-9969-fa4b580cc98a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "cinder-quobyte-f8b08cbb-845d-4c79-9969-fa4b580cc98a" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-quobyte-f8b08cbb-845d-4c79-9969-fa4b580cc98a" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e4253e-db15-44d2-9d1a-b00a2250d54b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:41 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a Jul 23 10:36:41 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:41 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a" returned: 0 in 0.354s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:41 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a Jul 23 10:36:41 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:41 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f8b08cbb-845d-4c79-9969-fa4b580cc98a" returned: 0 in 0.236s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-quobyte-f8b08cbb-845d-4c79-9969-fa4b580cc98a" released by "delete_volume" :: held 0.623s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Created reservations ['cfd58a46-080d-4c02-ab54-fe87fe7a9e0f', '3ca52e07-ad94-4959-ba08-c8f0fd55cec4', '4b471c13-6202-4abc-a355-244f0c3b913c', 'be985ead-d039-47cf-b4ad-f45426530710'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:41 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:41 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:41 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.240s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:41 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Deleted volume successfully. Jul 23 10:36:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b36a2977-9860-4797-9709-900c4f699caf tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-f8b08cbb-845d-4c79-9969-fa4b580cc98a-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "cinder-29b7cf1e-255c-4357-814c-4be9729bebc7-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-29b7cf1e-255c-4357-814c-4be9729bebc7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "cinder-quobyte-29b7cf1e-255c-4357-814c-4be9729bebc7" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-quobyte-29b7cf1e-255c-4357-814c-4be9729bebc7" acquired by "delete_volume" :: waited 0.013s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b054ab2-e7cf-4346-8fdb-51b02f5d2a81]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:42 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7 Jul 23 10:36:42 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:42 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7" returned: 0 in 0.344s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:42 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7 Jul 23 10:36:42 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:42 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-29b7cf1e-255c-4357-814c-4be9729bebc7" returned: 0 in 0.234s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-quobyte-29b7cf1e-255c-4357-814c-4be9729bebc7" released by "delete_volume" :: held 0.619s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Created reservations ['31f31300-f34e-4da7-ab38-d9dc02877b9f', 'd4b93c7d-4763-4241-a9df-10f9ce547b29', '90614ca9-3383-414c-9f84-08c050e74710', '53ab8cf3-05c5-487c-ac9b-f8147449709f'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:42 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:42 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:43 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.236s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:43 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Deleted volume successfully. Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bf528028-dd43-4a15-acdc-e1d78c9e0d21 tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-29b7cf1e-255c-4357-814c-4be9729bebc7-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "cinder-46a0fba3-48fb-458b-ae4f-acf851fb7730-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-46a0fba3-48fb-458b-ae4f-acf851fb7730-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "cinder-quobyte-46a0fba3-48fb-458b-ae4f-acf851fb7730" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-quobyte-46a0fba3-48fb-458b-ae4f-acf851fb7730" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[524072ef-507b-4067-ac6e-5f5b2a0a82dd]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:43 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730 Jul 23 10:36:43 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:43 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730" returned: 0 in 0.345s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:43 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730 Jul 23 10:36:43 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:43 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-46a0fba3-48fb-458b-ae4f-acf851fb7730" returned: 0 in 0.241s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-quobyte-46a0fba3-48fb-458b-ae4f-acf851fb7730" released by "delete_volume" :: held 0.622s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Created reservations ['e832ab38-8d7f-4f1f-a129-4bb7a52c4a0b', '5c490785-f828-4285-910e-531a2ef42df4', 'c9ef9d84-54c6-4073-b498-ca3508a762e0', '30e4814b-7a2f-404d-871b-22fda0949a16'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:43 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:43 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:44 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.241s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:44 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:44 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Deleted volume successfully. Jul 23 10:36:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0e8f7b84-ff61-45c6-b630-ab0e2704a59e tempest-CreateVolumesFromImageTest-1126454937 None] Lock "cinder-46a0fba3-48fb-458b-ae4f-acf851fb7730-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:46 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:46 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:46 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.258s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:36:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (0f8fecb8-81d5-4656-9f73-82ca865f62f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2bdc6c-30d5-4498-9386-cdc7822e02e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2bdc6c-30d5-4498-9386-cdc7822e02e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1973495192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7b5516-2c54-42aa-8d53-fa2e8857b474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:47Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d38382-1555-4361-beb6-ac8e4c2f11d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d38382-1555-4361-beb6-ac8e4c2f11d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5b7df0-a2ff-424c-8881-184844bdcb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5b7df0-a2ff-424c-8881-184844bdcb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7b5516-2c54-42aa-8d53-fa2e8857b474', 'volume_name': 'volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f893f575-026c-4afb-8bb8-40aaf1edcdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f893f575-026c-4afb-8bb8-40aaf1edcdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace148ea-1dd6-488a-9410-adbafced9d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:47 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume fc7b5516-2c54-42aa-8d53-fa2e8857b474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474', 'volume_size': 1} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1973495192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7b5516-2c54-42aa-8d53-fa2e8857b474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:47Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Creating volume fc7b5516-2c54-42aa-8d53-fa2e8857b474 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:47 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:47 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474 1073741824 Jul 23 10:36:47 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:47 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474 1073741824" returned: 0 in 0.409s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:47 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474 Jul 23 10:36:47 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:47 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474" returned: 0 in 0.256s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace148ea-1dd6-488a-9410-adbafced9d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bf6563-ad2f-4104-a8b1-c828364e00b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:47 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474 (fc7b5516-2c54-42aa-8d53-fa2e8857b474): created successfully Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bf6563-ad2f-4104-a8b1-c828364e00b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:47 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (0f8fecb8-81d5-4656-9f73-82ca865f62f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:47 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b1523537-f053-4abd-a4ff-35b9807995d5 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created volume successfully. Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (065a441b-5043-4af9-a238-b346f771a7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647f8045-1acb-4248-830c-eb6e859d744d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647f8045-1acb-4248-830c-eb6e859d744d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-521788827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9353ca7-275a-42aa-8012-2f765a81a3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:48Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208f64df-8dbd-40d7-9022-675eb9bdf070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208f64df-8dbd-40d7-9022-675eb9bdf070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3144e5f-897e-4f00-a20d-0490e6ac3155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3144e5f-897e-4f00-a20d-0490e6ac3155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9353ca7-275a-42aa-8012-2f765a81a3f1', 'volume_name': 'volume-d9353ca7-275a-42aa-8012-2f765a81a3f1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f630e16-126c-4844-8738-94bbd4cac36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f630e16-126c-4844-8738-94bbd4cac36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41c2c9d-079a-48a3-929f-26a767758662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:48 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume d9353ca7-275a-42aa-8012-2f765a81a3f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9353ca7-275a-42aa-8012-2f765a81a3f1', 'volume_size': 1} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-521788827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9353ca7-275a-42aa-8012-2f765a81a3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:48Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Creating volume d9353ca7-275a-42aa-8012-2f765a81a3f1 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:48 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:48 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1 1073741824 Jul 23 10:36:48 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (9ac73caf-03cb-4fae-a098-604b9f081aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6ef7a9-ec17-4d29-b356-6853b949ecaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6ef7a9-ec17-4d29-b356-6853b949ecaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-649405553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c685733-f5e6-472c-a46a-a6e2616ad21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:49Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec3834b-1bc5-445b-9d17-de4e4399d745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec3834b-1bc5-445b-9d17-de4e4399d745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d980f2f9-6cea-4500-82d0-212957917a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d980f2f9-6cea-4500-82d0-212957917a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c685733-f5e6-472c-a46a-a6e2616ad21f', 'volume_name': 'volume-9c685733-f5e6-472c-a46a-a6e2616ad21f', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df731b9-7e84-4385-82a9-13518738212e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df731b9-7e84-4385-82a9-13518738212e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e7560a-208f-40ac-b762-9bc14825ca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:48 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume 9c685733-f5e6-472c-a46a-a6e2616ad21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c685733-f5e6-472c-a46a-a6e2616ad21f', 'volume_size': 1} Jul 23 10:36:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:49 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1 1073741824" returned: 0 in 0.463s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:49 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1 Jul 23 10:36:49 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (7edaef6a-070c-49df-ac5a-8caa7817949e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b28d23-d6f2-40fe-9fe6-ec690368f936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b28d23-d6f2-40fe-9fe6-ec690368f936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-78820739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78ad4be-0155-4a4e-8291-106700f902e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:49Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a857c21-cc5d-4dbe-85fd-93eede973f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a857c21-cc5d-4dbe-85fd-93eede973f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6026207c-97b5-4ee4-96ff-aac7fe4ca7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6026207c-97b5-4ee4-96ff-aac7fe4ca7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e78ad4be-0155-4a4e-8291-106700f902e3', 'volume_name': 'volume-e78ad4be-0155-4a4e-8291-106700f902e3', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8bacab-98bb-40ff-9d9e-bd6cc2d3f97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8bacab-98bb-40ff-9d9e-bd6cc2d3f97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c42c47-e6d8-49cb-9ec1-6f907910ebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume e78ad4be-0155-4a4e-8291-106700f902e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e78ad4be-0155-4a4e-8291-106700f902e3', 'volume_size': 1} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:49 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1" returned: 0 in 0.265s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.410s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-649405553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c685733-f5e6-472c-a46a-a6e2616ad21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:49Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Creating volume 9c685733-f5e6-472c-a46a-a6e2616ad21f {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:49 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41c2c9d-079a-48a3-929f-26a767758662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9353ca7-275a-42aa-8012-2f765a81a3f1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:49 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f 1073741824 Jul 23 10:36:49 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a7d4d8-3b6b-49c8-9b6d-ccc128378a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume volume-d9353ca7-275a-42aa-8012-2f765a81a3f1 (d9353ca7-275a-42aa-8012-2f765a81a3f1): created successfully Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a7d4d8-3b6b-49c8-9b6d-ccc128378a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (065a441b-5043-4af9-a238-b346f771a7cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:49 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d6f040b9-6d32-408d-bedb-15ea2752ac95 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created volume successfully. Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (28ee54b3-31f7-442f-9ec4-a3cf41f225dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b141e3-68c3-4eb3-91a5-df89fb170b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b141e3-68c3-4eb3-91a5-df89fb170b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1894205556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c581e897-7cd7-4b16-9b3a-5e7bf4808dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:50Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64bbffed-b5bc-444b-ba9b-e83de473d5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64bbffed-b5bc-444b-ba9b-e83de473d5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bafecec-6e47-483f-b115-7eea0a27be76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bafecec-6e47-483f-b115-7eea0a27be76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c581e897-7cd7-4b16-9b3a-5e7bf4808dd1', 'volume_name': 'volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5b9676-b0e8-426f-a2d2-bb92c29a3088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5b9676-b0e8-426f-a2d2-bb92c29a3088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e872b3-4962-4b3a-9f81-3bd131156762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume c581e897-7cd7-4b16-9b3a-5e7bf4808dd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1', 'volume_size': 1} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:49 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f 1073741824" returned: 0 in 0.484s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:49 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f Jul 23 10:36:49 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (1ccced0e-1409-4d69-831c-e1babf03194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae74491-1f2a-4cd6-93f9-215b5aef9a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae74491-1f2a-4cd6-93f9-215b5aef9a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257176434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a93013-5889-4067-9dcf-5ff13be703a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:50Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b6058a-3f22-41a5-a0c1-6277e4c79604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b6058a-3f22-41a5-a0c1-6277e4c79604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdfe983-5854-4490-b4be-f95deb7baf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdfe983-5854-4490-b4be-f95deb7baf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74a93013-5889-4067-9dcf-5ff13be703a1', 'volume_name': 'volume-74a93013-5889-4067-9dcf-5ff13be703a1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7974b98d-feec-41a3-9103-2fc301d77651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7974b98d-feec-41a3-9103-2fc301d77651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692644ca-e986-4059-ad55-af61056bd952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:50 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume 74a93013-5889-4067-9dcf-5ff13be703a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74a93013-5889-4067-9dcf-5ff13be703a1', 'volume_size': 1} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:50 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f" returned: 0 in 0.258s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-78820739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78ad4be-0155-4a4e-8291-106700f902e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:49Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Creating volume e78ad4be-0155-4a4e-8291-106700f902e3 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:50 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e7560a-208f-40ac-b762-9bc14825ca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c685733-f5e6-472c-a46a-a6e2616ad21f', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:50 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3 1073741824 Jul 23 10:36:50 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a61dd9-93fe-449f-af62-c9c71c6d2572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:50 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume volume-9c685733-f5e6-472c-a46a-a6e2616ad21f (9c685733-f5e6-472c-a46a-a6e2616ad21f): created successfully Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a61dd9-93fe-449f-af62-c9c71c6d2572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (9ac73caf-03cb-4fae-a098-604b9f081aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:50 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-002e995f-e120-44e3-a194-3c70daf16ec2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created volume successfully. Jul 23 10:36:50 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3 1073741824" returned: 0 in 0.434s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:50 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3 Jul 23 10:36:50 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:50 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1894205556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c581e897-7cd7-4b16-9b3a-5e7bf4808dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:50Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Creating volume c581e897-7cd7-4b16-9b3a-5e7bf4808dd1 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:50 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c42c47-e6d8-49cb-9ec1-6f907910ebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e78ad4be-0155-4a4e-8291-106700f902e3', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:50 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1 1073741824 Jul 23 10:36:50 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67756912-c3c8-4eb2-8a40-69f9020db1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:50 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume volume-e78ad4be-0155-4a4e-8291-106700f902e3 (e78ad4be-0155-4a4e-8291-106700f902e3): created successfully Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67756912-c3c8-4eb2-8a40-69f9020db1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:50 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (7edaef6a-070c-49df-ac5a-8caa7817949e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:50 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-cf7df5db-54f8-4cd2-84c7-55926a52b85a tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created volume successfully. Jul 23 10:36:51 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1 1073741824" returned: 0 in 0.425s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:51 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1 Jul 23 10:36:51 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:51 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1" returned: 0 in 0.259s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.565s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257176434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a93013-5889-4067-9dcf-5ff13be703a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a65ed99aa409aa7a4345277486d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:36:50Z,use_quota=True,user_id='b37ac613b9e04fcf8ab9ff159310ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Creating volume 74a93013-5889-4067-9dcf-5ff13be703a1 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:36:51 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e872b3-4962-4b3a-9f81-3bd131156762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:51 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1 1073741824 Jul 23 10:36:51 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb328a33-bb69-4ec1-a345-21587822d811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:51 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1 (c581e897-7cd7-4b16-9b3a-5e7bf4808dd1): created successfully Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb328a33-bb69-4ec1-a345-21587822d811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (28ee54b3-31f7-442f-9ec4-a3cf41f225dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:51 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-57f13841-1621-4c1d-aa5e-a7b22c78bde6 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created volume successfully. Jul 23 10:36:52 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1 1073741824" returned: 0 in 0.441s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:52 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1 Jul 23 10:36:52 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:52 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:36:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692644ca-e986-4059-ad55-af61056bd952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74a93013-5889-4067-9dcf-5ff13be703a1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f619ac56-0bb2-4697-a290-99bea744dad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:36:52 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Volume volume-74a93013-5889-4067-9dcf-5ff13be703a1 (74a93013-5889-4067-9dcf-5ff13be703a1): created successfully Jul 23 10:36:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f619ac56-0bb2-4697-a290-99bea744dad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:36:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Flow 'volume_create_manager' (1ccced0e-1409-4d69-831c-e1babf03194d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:36:52 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4572998c-68a7-43eb-b425-ca19c4f935c7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created volume successfully. Jul 23 10:36:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-74a93013-5889-4067-9dcf-5ff13be703a1-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-74a93013-5889-4067-9dcf-5ff13be703a1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-quobyte-74a93013-5889-4067-9dcf-5ff13be703a1" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-74a93013-5889-4067-9dcf-5ff13be703a1" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4090978-4267-4e86-bd02-ceeac1f33be4]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:53 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1 Jul 23 10:36:53 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:53 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1" returned: 0 in 0.351s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:53 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1 Jul 23 10:36:53 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:54 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-74a93013-5889-4067-9dcf-5ff13be703a1" returned: 0 in 0.250s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-74a93013-5889-4067-9dcf-5ff13be703a1" released by "delete_volume" :: held 0.637s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created reservations ['7411d666-aee3-4626-899a-9db66bd6d232', '1d42d30e-0a99-430e-bc32-0040fd09da40', 'd80e132c-4818-46f4-b6a2-27b66cc837ac', 'e8bbf85c-8885-4af6-acc4-7dfad46b7f17'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:54 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:54 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:54 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.244s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:54 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Deleted volume successfully. Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-49edb423-b4aa-4326-b651-315b53f7e7e3 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-74a93013-5889-4067-9dcf-5ff13be703a1-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-quobyte-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76354b2-6a71-4db2-96c8-4690b14e58cd]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:54 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1 Jul 23 10:36:54 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:54 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1" returned: 0 in 0.367s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:54 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1 Jul 23 10:36:54 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:55 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1" returned: 0 in 0.249s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1" released by "delete_volume" :: held 0.653s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created reservations ['9e665a79-710d-4c3f-834b-37d3de860169', '6ff47922-5f84-4f80-918d-07ec88bb49ab', '1b40aa32-8667-4635-a32a-5c3b5cd66457', 'ea46b6cb-6c07-4552-bd19-f80883bb0132'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:55 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:55 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:55 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.239s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Deleted volume successfully. Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-784cab31-1269-41a4-b470-0ea48a087c6e tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-c581e897-7cd7-4b16-9b3a-5e7bf4808dd1-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-e78ad4be-0155-4a4e-8291-106700f902e3-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-e78ad4be-0155-4a4e-8291-106700f902e3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-quobyte-e78ad4be-0155-4a4e-8291-106700f902e3" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-e78ad4be-0155-4a4e-8291-106700f902e3" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eef53a-c61c-471c-8fd6-a5fa0552926d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:55 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3 Jul 23 10:36:55 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:56 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3" returned: 0 in 0.351s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:56 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3 Jul 23 10:36:56 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:56 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e78ad4be-0155-4a4e-8291-106700f902e3" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-e78ad4be-0155-4a4e-8291-106700f902e3" released by "delete_volume" :: held 0.633s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created reservations ['b8235649-b2a3-4b9f-9f8a-085b21183ace', 'b7eaa37e-473b-46c3-a03d-b06ae3cdafaf', '5596564b-6665-41d4-afa6-f93bb6369446', '3f0dfddd-33bf-4172-a7ef-764e2065b8ef'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:56 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:56 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:56 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.242s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:56 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Deleted volume successfully. Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6e39a8c6-b027-401f-8962-e00de93d8dd2 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-e78ad4be-0155-4a4e-8291-106700f902e3-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-9c685733-f5e6-472c-a46a-a6e2616ad21f-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-9c685733-f5e6-472c-a46a-a6e2616ad21f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-quobyte-9c685733-f5e6-472c-a46a-a6e2616ad21f" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-9c685733-f5e6-472c-a46a-a6e2616ad21f" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c626f7a-55e1-49b1-8c7d-bfbfa0f1d9df]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:57 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f Jul 23 10:36:57 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:57 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f" returned: 0 in 0.344s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:57 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f Jul 23 10:36:57 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:57 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9c685733-f5e6-472c-a46a-a6e2616ad21f" returned: 0 in 0.241s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-9c685733-f5e6-472c-a46a-a6e2616ad21f" released by "delete_volume" :: held 0.622s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created reservations ['345ee6af-a43e-4910-87fe-16366c5a71dc', 'e5a75609-bb60-47fb-bf5a-ddf456c0e259', '29a09425-968b-429f-99c5-42667aa25e94', 'd16a6970-df70-4b05-8524-ba13bf1b071a'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:57 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:57 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:57 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.245s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Deleted volume successfully. Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-993fe186-97cd-47f2-9753-2affcca6f3a1 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-9c685733-f5e6-472c-a46a-a6e2616ad21f-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-d9353ca7-275a-42aa-8012-2f765a81a3f1-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-d9353ca7-275a-42aa-8012-2f765a81a3f1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-quobyte-d9353ca7-275a-42aa-8012-2f765a81a3f1" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-d9353ca7-275a-42aa-8012-2f765a81a3f1" acquired by "delete_volume" :: waited 0.013s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[218efaa2-646c-4453-acf4-775079290bb3]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:58 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1 Jul 23 10:36:58 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:58 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1" returned: 0 in 0.379s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:58 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1 Jul 23 10:36:58 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:58 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d9353ca7-275a-42aa-8012-2f765a81a3f1" returned: 0 in 0.238s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-d9353ca7-275a-42aa-8012-2f765a81a3f1" released by "delete_volume" :: held 0.654s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created reservations ['00e08ead-49e4-40ca-ac94-97e0c0ad025c', 'a4a1f04f-059d-4f9c-a9cf-77363431dc6e', 'dc25094a-1fb5-4db2-a012-079569701897', 'b83fc82a-66d4-4a13-b42a-caa1f9fa7cdc'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:58 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:58 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:59 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.248s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:36:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Deleted volume successfully. Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-da72c1c8-9bf8-42bb-91b5-cca5c81fc609 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-d9353ca7-275a-42aa-8012-2f765a81a3f1-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-fc7b5516-2c54-42aa-8d53-fa2e8857b474-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-fc7b5516-2c54-42aa-8d53-fa2e8857b474-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "cinder-quobyte-fc7b5516-2c54-42aa-8d53-fa2e8857b474" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-fc7b5516-2c54-42aa-8d53-fa2e8857b474" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf46c483-3486-4519-ae44-d593889669a0]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:59 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474 Jul 23 10:36:59 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:59 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474" returned: 0 in 0.342s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:59 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474 Jul 23 10:36:59 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:36:59 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fc7b5516-2c54-42aa-8d53-fa2e8857b474" returned: 0 in 0.250s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-quobyte-fc7b5516-2c54-42aa-8d53-fa2e8857b474" released by "delete_volume" :: held 0.631s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Created reservations ['8a929b47-9a55-43d6-b3d5-0800677eb7c8', '6dc9f2d2-fb75-4ebe-8b18-456fa8bdd301', 'b37044bc-5f4d-471e-b160-d084ef86aeb0', '89db6469-6ac0-42ca-84ed-df890ada917d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:36:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:36:59 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:36:59 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:00 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.239s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:00 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Deleted volume successfully. Jul 23 10:37:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e395bc-b2ba-464c-bb6a-6e9f72d586b7 tempest-CreateVolumesFromSourceVolumeTest-846511899 None] Lock "cinder-fc7b5516-2c54-42aa-8d53-fa2e8857b474-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Flow 'volume_create_manager' (27e07160-a953-43dd-9899-e937cd728dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59526bf3-20db-4daa-bfd6-62d0c9036b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59526bf3-20db-4daa-bfd6-62d0c9036b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1953675562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e3c297-30bc-4598-8c02-f82d286f9ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b715a8edded4e2bab8bce873e33b8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:03Z,use_quota=True,user_id='f59aeb96a2b54394b4e0c7f5a4c82085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5795ea3-775b-4836-8606-ad60e21e42c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5795ea3-775b-4836-8606-ad60e21e42c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d36095-d588-4f76-98b2-7636f91ebc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d36095-d588-4f76-98b2-7636f91ebc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e3c297-30bc-4598-8c02-f82d286f9ab8', 'volume_name': 'volume-68e3c297-30bc-4598-8c02-f82d286f9ab8', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5e82df-85ed-4c65-b10a-1c245ec2d19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5e82df-85ed-4c65-b10a-1c245ec2d19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535fb7f8-cf25-4d64-ba91-37d77233e79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:03 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Volume 68e3c297-30bc-4598-8c02-f82d286f9ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e3c297-30bc-4598-8c02-f82d286f9ab8', 'volume_size': 1} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1953675562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e3c297-30bc-4598-8c02-f82d286f9ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b715a8edded4e2bab8bce873e33b8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:03Z,use_quota=True,user_id='f59aeb96a2b54394b4e0c7f5a4c82085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Creating volume 68e3c297-30bc-4598-8c02-f82d286f9ab8 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:03 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:03 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 1073741824 Jul 23 10:37:03 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:03 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 1073741824" returned: 0 in 0.400s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:03 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 Jul 23 10:37:03 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:04 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8" returned: 0 in 0.239s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535fb7f8-cf25-4d64-ba91-37d77233e79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e3c297-30bc-4598-8c02-f82d286f9ab8', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dbd7ec-8fea-443b-882c-3e5080b683fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:04 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Volume volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 (68e3c297-30bc-4598-8c02-f82d286f9ab8): created successfully Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dbd7ec-8fea-443b-882c-3e5080b683fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Flow 'volume_create_manager' (27e07160-a953-43dd-9899-e937cd728dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-64425ef8-e89b-4fb6-8e6c-893a80e60386 tempest-VolumeDependencyTests-52553491 None] Created volume successfully. Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] Creating offline snapshot 9876bb14-aa01-48f1-93b0-85a8a7a31b2f of volume 68e3c297-30bc-4598-8c02-f82d286f9ab8 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f24bc44-821e-4af7-acae-1c04e15408aa]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:04 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 Jul 23 10:37:04 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:04 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8" returned: 0 in 0.382s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:04 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f 1G Jul 23 10:37:04 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:05 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f 1G" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:05 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f Jul 23 10:37:05 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:05 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f" returned: 0 in 0.281s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:05 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f is being set with open permissions: ugo+rw Jul 23 10:37:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:05 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f Jul 23 10:37:05 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:05 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f" returned: 0 in 0.243s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:05 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.info Jul 23 10:37:05 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:06 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.info" returned: 0 in 0.256s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:06 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.info is being set with open permissions: ugo+rw Jul 23 10:37:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:06 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.info Jul 23 10:37:06 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:06 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.info" returned: 0 in 0.243s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:06 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a1cfe934-3173-48d9-8f38-f8d90cd1571f tempest-VolumeDependencyTests-52553491 None] Create snapshot completed successfully Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Flow 'volume_create_manager' (bb8f8c38-9199-4232-9447-76656bb781d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69df044-89ea-4865-bccc-ee0d0abe3a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69df044-89ea-4865-bccc-ee0d0abe3a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1665728611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c93fff1-7092-4078-a66b-e55e7b43f93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b715a8edded4e2bab8bce873e33b8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9876bb14-aa01-48f1-93b0-85a8a7a31b2f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:07Z,use_quota=True,user_id='f59aeb96a2b54394b4e0c7f5a4c82085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41ed54f-42eb-4b37-9e84-a16d6b17c8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41ed54f-42eb-4b37-9e84-a16d6b17c8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ab03cc-6f04-41db-a2c2-04cb7e19fc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ab03cc-6f04-41db-a2c2-04cb7e19fc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c93fff1-7092-4078-a66b-e55e7b43f93c', 'volume_name': 'volume-5c93fff1-7092-4078-a66b-e55e7b43f93c', 'volume_size': 1, 'snapshot_id': '9876bb14-aa01-48f1-93b0-85a8a7a31b2f'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69acda51-08d0-420d-8875-e73884a16294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69acda51-08d0-420d-8875-e73884a16294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85835f1-381f-4e63-aa7b-c7fbca9eeb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:07 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Volume 5c93fff1-7092-4078-a66b-e55e7b43f93c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c93fff1-7092-4078-a66b-e55e7b43f93c', 'volume_size': 1, 'snapshot_id': '9876bb14-aa01-48f1-93b0-85a8a7a31b2f'} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Acquiring lock "cinder-quobyte-9876bb14-aa01-48f1-93b0-85a8a7a31b2f-5c93fff1-7092-4078-a66b-e55e7b43f93c" by "_create_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-9876bb14-aa01-48f1-93b0-85a8a7a31b2f-5c93fff1-7092-4078-a66b-e55e7b43f93c" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Creating volume 5c93fff1-7092-4078-a66b-e55e7b43f93c from snapshot 9876bb14-aa01-48f1-93b0-85a8a7a31b2f {{(pid=88371) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Acquiring lock "cinder-quobyte-5c93fff1-7092-4078-a66b-e55e7b43f93c" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-5c93fff1-7092-4078-a66b-e55e7b43f93c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] snapshot: 9876bb14-aa01-48f1-93b0-85a8a7a31b2f, volume: 5c93fff1-7092-4078-a66b-e55e7b43f93c, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6cab45-a6c4-4c34-9a3d-737401ce87cd]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:07 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f Jul 23 10:37:07 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:07 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f" returned: 0 in 0.359s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68e3c297-30bc-4598-8c02-f82d286f9ab8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbad74f-f1fe-4e29-a627-4b0477b6576a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:07 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 Jul 23 10:37:07 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:07 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8" returned: 0 in 0.353s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:37:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:07 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c Jul 23 10:37:07 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:11 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c" returned: 0 in 3.941s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:11 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e4aad5-dd88-458d-8598-521298fa0385]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:12 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 Jul 23 10:37:12 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:12 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8" returned: 0 in 0.518s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:12 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8, size 1024.00 MB, duration 3.94 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:37:12 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Converted 1024.00 MB image at 259.75 MB/s Jul 23 10:37:12 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c is being set with open permissions: ugo+rw Jul 23 10:37:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:12 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c Jul 23 10:37:12 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:12 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c" returned: 0 in 0.245s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-5c93fff1-7092-4078-a66b-e55e7b43f93c" released by "_copy_volume_from_snapshot" :: held 5.502s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-9876bb14-aa01-48f1-93b0-85a8a7a31b2f-5c93fff1-7092-4078-a66b-e55e7b43f93c" released by "_create_volume_from_snapshot" :: held 5.531s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.546s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85835f1-381f-4e63-aa7b-c7fbca9eeb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c93fff1-7092-4078-a66b-e55e7b43f93c', 'volume_size': 1, 'snapshot_id': '9876bb14-aa01-48f1-93b0-85a8a7a31b2f'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7649e647-84ea-4976-9592-495acb7cfce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:12 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Volume volume-5c93fff1-7092-4078-a66b-e55e7b43f93c (5c93fff1-7092-4078-a66b-e55e7b43f93c): created successfully Jul 23 10:37:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7649e647-84ea-4976-9592-495acb7cfce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Flow 'volume_create_manager' (bb8f8c38-9199-4232-9447-76656bb781d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:12 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ce4d4e9b-b460-4b2d-8ac5-d030b4b64e49 tempest-VolumeDependencyTests-52553491 None] Created volume successfully. Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Acquiring lock "cinder-9876bb14-aa01-48f1-93b0-85a8a7a31b2f-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Lock "cinder-9876bb14-aa01-48f1-93b0-85a8a7a31b2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Acquiring lock "cinder-quobyte-68e3c297-30bc-4598-8c02-f82d286f9ab8" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-68e3c297-30bc-4598-8c02-f82d286f9ab8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Acquiring lock "cinder-quobyte-9876bb14-aa01-48f1-93b0-85a8a7a31b2f" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-9876bb14-aa01-48f1-93b0-85a8a7a31b2f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Deleting offline snapshot 9876bb14-aa01-48f1-93b0-85a8a7a31b2f of volume 68e3c297-30bc-4598-8c02-f82d286f9ab8 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] snapshot_file for this snap is: volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c431acae-837c-4089-83ab-86c535a60095]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:13 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f Jul 23 10:37:13 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:13 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f" returned: 0 in 0.356s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68e3c297-30bc-4598-8c02-f82d286f9ab8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[098a632e-0284-4bac-89a7-eeb66fe071d1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:14 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 Jul 23 10:37:14 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:14 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8" returned: 0 in 0.342s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:14 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f Jul 23 10:37:14 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:14 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f" returned: 0 in 0.313s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:14 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f Jul 23 10:37:14 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:14 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8.9876bb14-aa01-48f1-93b0-85a8a7a31b2f" returned: 0 in 0.236s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-9876bb14-aa01-48f1-93b0-85a8a7a31b2f" released by "_delete_snapshot" :: held 1.339s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-68e3c297-30bc-4598-8c02-f82d286f9ab8" released by "delete_snapshot" :: held 1.360s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:14 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Created reservations ['9a80c0f1-60f9-4db4-bfd6-ab0d909df5c4', '2b3545a5-139e-41f0-9a53-f721992231da', 'c801eb3c-df75-472f-88e9-b1614f285f46', '5b392d63-671e-454f-a0a8-5a77e08d0db5'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Delete snapshot completed successfully. Jul 23 10:37:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-9053f578-edf8-445d-a50f-64d2af6a1dec tempest-VolumeDependencyTests-52553491 None] Lock "cinder-9876bb14-aa01-48f1-93b0-85a8a7a31b2f-delete_snapshot" released by "delete_snapshot" :: held 1.492s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Acquiring lock "cinder-68e3c297-30bc-4598-8c02-f82d286f9ab8-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Lock "cinder-68e3c297-30bc-4598-8c02-f82d286f9ab8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Acquiring lock "cinder-quobyte-68e3c297-30bc-4598-8c02-f82d286f9ab8" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-68e3c297-30bc-4598-8c02-f82d286f9ab8" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:15 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[428ff150-23bb-414c-8529-3dce751359fc]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:15 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 Jul 23 10:37:15 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:16 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8" returned: 0 in 0.341s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:16 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8 Jul 23 10:37:16 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:16 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-68e3c297-30bc-4598-8c02-f82d286f9ab8" returned: 0 in 0.237s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-68e3c297-30bc-4598-8c02-f82d286f9ab8" released by "delete_volume" :: held 0.635s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Created reservations ['ac30e9a5-d684-4d22-8ea4-f5dadb2c2e3f', '444505dc-5021-4b09-8227-e68f4ddbbf2f', '68a4d5c5-746a-4f21-9b96-4ed9db3cf837', '5635fc74-77d5-40e3-9203-ea817761a262'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:16 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:16 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:16 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.235s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:16 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Deleted volume successfully. Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-eb1680f7-1886-41a5-aef5-9b4bd823968f tempest-VolumeDependencyTests-52553491 None] Lock "cinder-68e3c297-30bc-4598-8c02-f82d286f9ab8-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Acquiring lock "cinder-5c93fff1-7092-4078-a66b-e55e7b43f93c-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Lock "cinder-5c93fff1-7092-4078-a66b-e55e7b43f93c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Acquiring lock "cinder-quobyte-5c93fff1-7092-4078-a66b-e55e7b43f93c" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-5c93fff1-7092-4078-a66b-e55e7b43f93c" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b50bf3d-54c8-48af-967b-c894b8d0ff1c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:17 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c Jul 23 10:37:17 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:17 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c" returned: 0 in 0.347s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:17 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c Jul 23 10:37:17 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:17 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-5c93fff1-7092-4078-a66b-e55e7b43f93c" returned: 0 in 0.231s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Lock "cinder-quobyte-5c93fff1-7092-4078-a66b-e55e7b43f93c" released by "delete_volume" :: held 0.621s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Created reservations ['a2f97b1f-8f5d-4e36-8d3a-bbfa5f7f0961', '462fcfc5-757b-4077-b4ec-d2cdccc4ec21', 'a7a381b3-f1ec-49ba-a781-d2d6257a95ea', '699b735a-abb3-4470-b885-d9c9ff02c409'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:17 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:17 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:17 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.231s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Deleted volume successfully. Jul 23 10:37:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1eed66b1-9d87-436e-bd30-b8ae683b2c10 tempest-VolumeDependencyTests-52553491 None] Lock "cinder-5c93fff1-7092-4078-a66b-e55e7b43f93c-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:27 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=101,cinder:UPDATE=151,cinder:INSERT=41,cinder:DELETE=13 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:37:27 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=101,cinder:UPDATE=148,cinder:INSERT=28,cinder:DELETE=14 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Flow 'volume_create_manager' (bbd2bc84-efae-439b-9b3f-9f37039c2d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e4634b-1fcb-46ae-b548-2e30c5b37051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e4634b-1fcb-46ae-b548-2e30c5b37051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac3ba25-acb8-4e4d-af0f-32a58f6cf953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc29e0fb448e4dec922d1e452c558ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:31Z,use_quota=True,user_id='92f1fb5f052a49b3afb329dd0e34ab20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c829c5-a2bd-4a6e-8ce6-142d127f7837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c829c5-a2bd-4a6e-8ce6-142d127f7837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a04e2c5-6cc1-4f4e-b906-f91e59144d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a04e2c5-6cc1-4f4e-b906-f91e59144d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac3ba25-acb8-4e4d-af0f-32a58f6cf953', 'volume_name': 'volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (037a2469-0451-401d-852e-ddafd2cff09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (037a2469-0451-401d-852e-ddafd2cff09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749ef259-f069-4f6f-9be2-367cf6b88807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:31 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Volume fac3ba25-acb8-4e4d-af0f-32a58f6cf953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953', 'volume_size': 1} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac3ba25-acb8-4e4d-af0f-32a58f6cf953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc29e0fb448e4dec922d1e452c558ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:31Z,use_quota=True,user_id='92f1fb5f052a49b3afb329dd0e34ab20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Creating volume fac3ba25-acb8-4e4d-af0f-32a58f6cf953 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:31 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:31 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953 1073741824 Jul 23 10:37:31 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (c2db366e-77bb-4c0a-8608-a7af08ba7a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6b668a-5cc5-47dd-92d1-e5e3c955975c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6b668a-5cc5-47dd-92d1-e5e3c955975c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-496983869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a282e50-06ae-4ab8-9093-321a9a80f180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:32Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc012db5-dfe8-42ed-be67-1289e83dd651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc012db5-dfe8-42ed-be67-1289e83dd651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4050f742-c660-411e-94a5-fb5da2dbbdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4050f742-c660-411e-94a5-fb5da2dbbdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a282e50-06ae-4ab8-9093-321a9a80f180', 'volume_name': 'volume-9a282e50-06ae-4ab8-9093-321a9a80f180', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29051d37-b777-4646-b39a-19fb9c6567e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29051d37-b777-4646-b39a-19fb9c6567e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5019fa84-29d9-489b-ba7a-021cdf346372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:32 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume 9a282e50-06ae-4ab8-9093-321a9a80f180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a282e50-06ae-4ab8-9093-321a9a80f180', 'volume_size': 1} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:32 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953 1073741824" returned: 0 in 0.567s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:32 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953 Jul 23 10:37:32 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:32 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953" returned: 0 in 0.264s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.835s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-496983869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a282e50-06ae-4ab8-9093-321a9a80f180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:32Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Creating volume 9a282e50-06ae-4ab8-9093-321a9a80f180 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:32 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749ef259-f069-4f6f-9be2-367cf6b88807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4dd847-644c-49d1-b46f-0a0c982d2406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:32 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 1073741824 Jul 23 10:37:32 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:33 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Volume volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953 (fac3ba25-acb8-4e4d-af0f-32a58f6cf953): created successfully Jul 23 10:37:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4dd847-644c-49d1-b46f-0a0c982d2406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Flow 'volume_create_manager' (bbd2bc84-efae-439b-9b3f-9f37039c2d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:33 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-59aa4bf0-dced-4c2b-854a-0716017d4d3a tempest-CinderUnicodeTest-1152058452 None] Created volume successfully. Jul 23 10:37:33 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 1073741824" returned: 0 in 0.616s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:33 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 Jul 23 10:37:33 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:33 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180" returned: 0 in 0.352s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5019fa84-29d9-489b-ba7a-021cdf346372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a282e50-06ae-4ab8-9093-321a9a80f180', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ab1be4-88e3-41ac-85cc-bee42d55d90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:34 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume volume-9a282e50-06ae-4ab8-9093-321a9a80f180 (9a282e50-06ae-4ab8-9093-321a9a80f180): created successfully Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ab1be4-88e3-41ac-85cc-bee42d55d90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (c2db366e-77bb-4c0a-8608-a7af08ba7a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:34 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0b2fab47-1fa1-47e1-bfdf-57d9a9d3ce2e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created volume successfully. Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Flow 'volume_create_manager' (e0c030f4-2789-40a6-8f0a-3d4d7aeea1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191418dd-ce24-4550-a30e-7216456c2d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191418dd-ce24-4550-a30e-7216456c2d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1969700670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338fcb3f-0979-4cf8-b34d-4086eb4d0987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc29e0fb448e4dec922d1e452c558ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:34Z,use_quota=True,user_id='92f1fb5f052a49b3afb329dd0e34ab20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45991df1-8142-4967-8621-904143e87356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45991df1-8142-4967-8621-904143e87356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f7f67a-6f10-4c37-aa28-e7937f9b1133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f7f67a-6f10-4c37-aa28-e7937f9b1133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '338fcb3f-0979-4cf8-b34d-4086eb4d0987', 'volume_name': 'volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e84e3b2-9c61-41ea-8d67-abdebee1513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e84e3b2-9c61-41ea-8d67-abdebee1513b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d12c6d-365f-4182-9afc-23c819d4439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:34 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Volume 338fcb3f-0979-4cf8-b34d-4086eb4d0987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987', 'volume_size': 1} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1969700670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338fcb3f-0979-4cf8-b34d-4086eb4d0987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc29e0fb448e4dec922d1e452c558ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:34Z,use_quota=True,user_id='92f1fb5f052a49b3afb329dd0e34ab20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Creating volume 338fcb3f-0979-4cf8-b34d-4086eb4d0987 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:34 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:34 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 1073741824 Jul 23 10:37:34 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:34 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 1073741824" returned: 0 in 0.684s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:35 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 Jul 23 10:37:35 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:35 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987" returned: 0 in 0.312s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.331s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d12c6d-365f-4182-9afc-23c819d4439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a549bb-bdf3-4354-af45-3b307d7f7891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] Creating offline snapshot 0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 of volume 9a282e50-06ae-4ab8-9093-321a9a80f180 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:37:35 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Volume volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 (338fcb3f-0979-4cf8-b34d-4086eb4d0987): created successfully Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a549bb-bdf3-4354-af45-3b307d7f7891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Flow 'volume_create_manager' (e0c030f4-2789-40a6-8f0a-3d4d7aeea1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[054a0da5-6e76-4758-b304-a35ac29d6a1b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:35 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3f9152d2-eff8-41fb-af26-a84ed23df6da tempest-CinderUnicodeTest-1152058452 None] Created volume successfully. Jul 23 10:37:35 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 Jul 23 10:37:35 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:35 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180" returned: 0 in 0.482s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:35 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 1G Jul 23 10:37:35 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Flow 'volume_create_manager' (b5257752-9a51-477f-af91-2b075e621c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b4f415-81f8-4fc7-a7cd-36b32df30a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:36 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 1G" returned: 0 in 0.592s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a282e50-06ae-4ab8-9093-321a9a80f180 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:36 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a282e50-06ae-4ab8-9093-321a9a80f180 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b4f415-81f8-4fc7-a7cd-36b32df30a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d787ce-6eda-46e8-97c7-33232634c5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3bb6d6039d456ab3d3f16fbd78023f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:36Z,use_quota=True,user_id='e9232cca9b764ca697c5269a01895062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fa95a6a-1d37-4044-80fd-ab6cf4070ee1),volume_type_id=8fa95a6a-1d37-4044-80fd-ab6cf4070ee1)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:36 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715e34c5-e7e5-497c-a421-6a10e4247705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715e34c5-e7e5-497c-a421-6a10e4247705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fae633-991b-4093-bcb2-3e5a112eeaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG cinder.image.glance [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Creating Keystone auth plugin from conf {{(pid=88371) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:36 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a282e50-06ae-4ab8-9093-321a9a80f180 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5" returned: 0 in 0.399s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:36 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 is being set with open permissions: ugo+rw Jul 23 10:37:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:36 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 Jul 23 10:37:36 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fae633-991b-4093-bcb2-3e5a112eeaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3d787ce-6eda-46e8-97c7-33232634c5b2', 'volume_name': 'volume-f3d787ce-6eda-46e8-97c7-33232634c5b2', 'volume_size': 1, 'image_id': '58d6a827-3975-4ca7-bb49-103395c10f9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58d6a827-3975-4ca7-bb49-103395c10f9c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40c6e81795d22730f31498b92d09a7b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d3bb6d6039d456ab3d3f16fbd78023f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42e9b352b99800de2d09726d309f2239d1436dd2b93fb5ddd35c288448d382472e149b46089950655c4d9e7a796fb5e5f1339e5b6837ac3e0f9b32fd0ad156f0', 'id': '58d6a827-3975-4ca7-bb49-103395c10f9c', 'created_at': datetime.datetime(2026, 7, 23, 8, 37, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 37, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58d6a827-3975-4ca7-bb49-103395c10f9c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d773c47-92f7-4be4-ac11-b5dce3682c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d773c47-92f7-4be4-ac11-b5dce3682c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cd5a34-439c-4b66-9392-fe5cc443cea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:37 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Volume f3d787ce-6eda-46e8-97c7-33232634c5b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3d787ce-6eda-46e8-97c7-33232634c5b2', 'volume_size': 1, 'image_id': '58d6a827-3975-4ca7-bb49-103395c10f9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58d6a827-3975-4ca7-bb49-103395c10f9c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40c6e81795d22730f31498b92d09a7b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d3bb6d6039d456ab3d3f16fbd78023f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42e9b352b99800de2d09726d309f2239d1436dd2b93fb5ddd35c288448d382472e149b46089950655c4d9e7a796fb5e5f1339e5b6837ac3e0f9b32fd0ad156f0', 'id': '58d6a827-3975-4ca7-bb49-103395c10f9c', 'created_at': datetime.datetime(2026, 7, 23, 8, 37, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 37, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58d6a827-3975-4ca7-bb49-103395c10f9c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Trying to clone f3d787ce-6eda-46e8-97c7-33232634c5b2 from image 58d6a827-3975-4ca7-bb49-103395c10f9c at location (None, [{'url': 'file:///opt/stack/data/glance/images/58d6a827-3975-4ca7-bb49-103395c10f9c', 'metadata': {}}]). {{(pid=88371) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 10:37:37 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5" returned: 0 in 0.333s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 10:37:37 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Image download 0.00 MB at 0.00 MB/s Jul 23 10:37:37 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.info Jul 23 10:37:37 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b069d681-7226-46e3-ba7f-c927f26bf0b6]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:37 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD Jul 23 10:37:37 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:37 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.info" returned: 0 in 0.319s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:37 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.info is being set with open permissions: ugo+rw Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:37 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.info Jul 23 10:37:37 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:37 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:37 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD Jul 23 10:37:37 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:37 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.info" returned: 0 in 0.256s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.234s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] Creating offline snapshot 891b3d21-b67d-4abf-9900-f01398170bd6 of volume 338fcb3f-0979-4cf8-b34d-4086eb4d0987 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988c807-f24f-46bc-8365-37470599c8a6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:37 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-99d3d43a-ce4c-40f4-a2f6-fdbf64237b1f tempest-CreateVolumesFromSnapshotTest-1857323136 None] Create snapshot completed successfully Jul 23 10:37:38 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 Jul 23 10:37:38 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:38 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Temporary image 58d6a827-3975-4ca7-bb49-103395c10f9c is fetched for user e9232cca9b764ca697c5269a01895062. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[099c1a0d-860a-4d51-9d15-abccbdb3be6c]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:38 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD Jul 23 10:37:38 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:38 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987" returned: 0 in 0.401s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:38 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 1G Jul 23 10:37:38 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:38 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:38 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD Jul 23 10:37:38 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (2a5042a7-33e9-4828-9b36-23780c89fa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a2c44e-1cbd-41b8-8350-ad2c15775ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a2c44e-1cbd-41b8-8350-ad2c15775ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992998192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:39Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9162eee2-66f2-46ed-9800-34b978730ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9162eee2-66f2-46ed-9800-34b978730ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb27c35-aa45-4a1e-9aeb-036d61ab4cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb27c35-aa45-4a1e-9aeb-036d61ab4cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7', 'volume_name': 'volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdec728-ee98-4f1b-82d2-3c091e2aa814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdec728-ee98-4f1b-82d2-3c091e2aa814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdd9e34-27da-46a0-8e34-eb067c8a622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:38 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7', 'volume_size': 1} Jul 23 10:37:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:39 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD" returned: 1 in 0.446s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:39 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 1G" returned: 0 in 0.698s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:39 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 Jul 23 10:37:39 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (8275fd44-0d44-4667-9ff7-9fdf3f26d3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3320f39e-4351-4382-8bdb-86f0fc81119c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3320f39e-4351-4382-8bdb-86f0fc81119c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1944876995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fcf459-57c9-4ef2-a2a4-6917831ba6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:39Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fead7a-f1ed-4b16-83f8-75a912484f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fead7a-f1ed-4b16-83f8-75a912484f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950c204c-af80-431a-ab53-c01373ac31b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950c204c-af80-431a-ab53-c01373ac31b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50fcf459-57c9-4ef2-a2a4-6917831ba6c6', 'volume_name': 'volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d73773a-d394-4667-82de-c7c2de6737ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d73773a-d394-4667-82de-c7c2de6737ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:39 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd49c3b-ee26-4b25-a75b-cbf3d9e7627c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:39 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume 50fcf459-57c9-4ef2-a2a4-6917831ba6c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6', 'volume_size': 1} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6" returned: 0 in 0.444s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:39 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 is being set with open permissions: ugo+rw Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:39 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 Jul 23 10:37:39 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:39 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6" returned: 0 in 0.304s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:39 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.info Jul 23 10:37:39 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (db6f1e42-29a0-4146-8778-bd500e1a60ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c889a4-3b98-4b0a-8678-86c5f8f4b90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c889a4-3b98-4b0a-8678-86c5f8f4b90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1054611893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:40Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6758ef96-8d73-404a-94f7-3aba6684c045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6758ef96-8d73-404a-94f7-3aba6684c045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae990ada-6a7a-4a68-9d7f-3499fa11997e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae990ada-6a7a-4a68-9d7f-3499fa11997e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487', 'volume_name': 'volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7730343d-19eb-43e6-b58e-3a995e579893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7730343d-19eb-43e6-b58e-3a995e579893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337a947e-22e5-40c0-be74-fa45ae583289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume 2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487', 'volume_size': 1} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:40 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.info" returned: 0 in 0.320s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:40 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.info is being set with open permissions: ugo+rw Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:40 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.info Jul 23 10:37:40 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (6646828c-b238-4597-862a-4f66d871af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67af2ef-d039-4e68-ac91-0c4c8f3f566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67af2ef-d039-4e68-ac91-0c4c8f3f566d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-929163138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733a4144-2f8a-4781-b647-85fc3a5b5419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:40Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9ea4ae-70d8-4dbf-b5b8-81a26d3e2390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9ea4ae-70d8-4dbf-b5b8-81a26d3e2390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9902a7d4-a5ae-4a59-915f-53673d019a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9902a7d4-a5ae-4a59-915f-53673d019a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733a4144-2f8a-4781-b647-85fc3a5b5419', 'volume_name': 'volume-733a4144-2f8a-4781-b647-85fc3a5b5419', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fdb95e-f1d2-47ba-8eb1-012061947d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fdb95e-f1d2-47ba-8eb1-012061947d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5539ce-fc14-409a-80aa-101be9a9e075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume 733a4144-2f8a-4781-b647-85fc3a5b5419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733a4144-2f8a-4781-b647-85fc3a5b5419', 'volume_size': 1} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:40 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.info" returned: 0 in 0.262s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992998192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:39Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Creating volume ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:40 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:40 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7 1073741824 Jul 23 10:37:40 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:40 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-24ae47ab-6ff0-418e-8b68-6185ba735962 tempest-CinderUnicodeTest-1152058452 None] Create snapshot completed successfully Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (1918d5a8-8b1c-4c3e-bfa5-b1967b9cab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a858cbb0-b937-4730-97ae-62f5a452f29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a858cbb0-b937-4730-97ae-62f5a452f29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1853905966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78196095-022b-4dfb-ae08-e1575d34d450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:41Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a04154-ddba-49a3-be79-5d09736fdbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a04154-ddba-49a3-be79-5d09736fdbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1095c762-9388-4998-856e-784279e6c743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1095c762-9388-4998-856e-784279e6c743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78196095-022b-4dfb-ae08-e1575d34d450', 'volume_name': 'volume-78196095-022b-4dfb-ae08-e1575d34d450', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93523e22-9165-4622-b424-6e31f7524dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93523e22-9165-4622-b424-6e31f7524dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb107027-40d4-468a-a036-17df68c22b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:40 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume 78196095-022b-4dfb-ae08-e1575d34d450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78196095-022b-4dfb-ae08-e1575d34d450', 'volume_size': 1} Jul 23 10:37:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:41 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7 1073741824" returned: 0 in 0.517s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "cinder-891b3d21-b67d-4abf-9900-f01398170bd6-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-891b3d21-b67d-4abf-9900-f01398170bd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "cinder-quobyte-338fcb3f-0979-4cf8-b34d-4086eb4d0987" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:41 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7 Jul 23 10:37:41 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-quobyte-338fcb3f-0979-4cf8-b34d-4086eb4d0987" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "cinder-quobyte-891b3d21-b67d-4abf-9900-f01398170bd6" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-quobyte-891b3d21-b67d-4abf-9900-f01398170bd6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Deleting offline snapshot 891b3d21-b67d-4abf-9900-f01398170bd6 of volume 338fcb3f-0979-4cf8-b34d-4086eb4d0987 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] snapshot_file for this snap is: volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67b63ca-6b31-401d-832e-727eb9364677]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:41 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 Jul 23 10:37:41 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:41 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7" returned: 0 in 0.314s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.315s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d787ce-6eda-46e8-97c7-33232634c5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3bb6d6039d456ab3d3f16fbd78023f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:36Z,use_quota=True,user_id='e9232cca9b764ca697c5269a01895062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fa95a6a-1d37-4044-80fd-ab6cf4070ee1),volume_type_id=8fa95a6a-1d37-4044-80fd-ab6cf4070ee1)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Creating volume f3d787ce-6eda-46e8-97c7-33232634c5b2 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:41 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdd9e34-27da-46a0-8e34-eb067c8a622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d002e6e7-b4a6-4321-ac1f-04f3ce86969f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:41 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 1073741824 Jul 23 10:37:41 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:41 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7 (ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7): created successfully Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d002e6e7-b4a6-4321-ac1f-04f3ce86969f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (2a5042a7-33e9-4828-9b36-23780c89fa73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:41 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3eba13a1-0487-45f2-965a-1f4ace420102 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created volume successfully. Jul 23 10:37:41 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6" returned: 0 in 0.494s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[598fa4f4-7606-4ef4-ba87-646b8c6c0da2]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:41 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 Jul 23 10:37:41 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:42 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 1073741824" returned: 0 in 0.614s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:42 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 Jul 23 10:37:42 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:42 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987" returned: 0 in 0.454s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:42 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 Jul 23 10:37:42 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:42 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2" returned: 0 in 0.267s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.798s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1944876995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fcf459-57c9-4ef2-a2a4-6917831ba6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:39Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Creating volume 50fcf459-57c9-4ef2-a2a4-6917831ba6c6 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:42 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:42 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6 1073741824 Jul 23 10:37:42 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Attempting download of 58d6a827-3975-4ca7-bb49-103395c10f9c ((None, [{'url': 'file:///opt/stack/data/glance/images/58d6a827-3975-4ca7-bb49-103395c10f9c', 'metadata': {}}])) to volume f3d787ce-6eda-46e8-97c7-33232634c5b2. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a5e1e8-edec-4eb0-9c19-f5438e92b4a0]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58d6a827-3975-4ca7-bb49-103395c10f9c_34zwhz_j {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:42 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58d6a827-3975-4ca7-bb49-103395c10f9c_34zwhz_j Jul 23 10:37:42 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:42 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:42 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6 Jul 23 10:37:42 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:42 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58d6a827-3975-4ca7-bb49-103395c10f9c_34zwhz_j" returned: 0 in 0.433s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58d6a827-3975-4ca7-bb49-103395c10f9c_34zwhz_j {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:42 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6 1073741824" returned: 0 in 0.565s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:42 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987.891b3d21-b67d-4abf-9900-f01398170bd6" returned: 0 in 0.340s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-quobyte-891b3d21-b67d-4abf-9900-f01398170bd6" released by "_delete_snapshot" :: held 1.828s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-quobyte-338fcb3f-0979-4cf8-b34d-4086eb4d0987" released by "delete_snapshot" :: held 1.868s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:43 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58d6a827-3975-4ca7-bb49-103395c10f9c_34zwhz_j Jul 23 10:37:43 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:43 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6 Jul 23 10:37:43 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Created reservations ['a2fe8e76-a026-4977-89de-f031b24df1dc', '444d318e-bcb9-4a75-92ff-c1cd84931110', '4e385382-4b69-4ce5-bb29-f93d0d992784', 'aef0b7fd-b232-4557-8f8d-9fc0947bfcf0'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:43 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Delete snapshot completed successfully. Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ea14800c-3af4-424a-92b9-fb4885ffa67c tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-891b3d21-b67d-4abf-9900-f01398170bd6-delete_snapshot" released by "delete_snapshot" :: held 2.092s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "cinder-338fcb3f-0979-4cf8-b34d-4086eb4d0987-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-338fcb3f-0979-4cf8-b34d-4086eb4d0987-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:43 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58d6a827-3975-4ca7-bb49-103395c10f9c_34zwhz_j" returned: 1 in 0.484s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58d6a827-3975-4ca7-bb49-103395c10f9c_34zwhz_j' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7deebdc-8f06-42f6-9db5-98220496bfb4]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:43 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6" returned: 0 in 0.399s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.311s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1054611893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:40Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Creating volume 2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:43 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "cinder-quobyte-338fcb3f-0979-4cf8-b34d-4086eb4d0987" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd49c3b-ee26-4b25-a75b-cbf3d9e7627c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:43 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487 1073741824 Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb83fa2d-d0ae-49e8-a528-7a19d33b6994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:43 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:43 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6 (50fcf459-57c9-4ef2-a2a4-6917831ba6c6): created successfully Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb83fa2d-d0ae-49e8-a528-7a19d33b6994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:43 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD Jul 23 10:37:43 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (8275fd44-0d44-4667-9ff7-9fdf3f26d3c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-quobyte-338fcb3f-0979-4cf8-b34d-4086eb4d0987" acquired by "delete_volume" :: waited 0.080s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:43 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7a4e1e94-af5f-4019-a02f-3b6d6be308ee tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created volume successfully. Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c7246d-be16-45ed-800d-88f75e12e28d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:43 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 Jul 23 10:37:43 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:43 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:44 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD Jul 23 10:37:44 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:44 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487 1073741824" returned: 0 in 0.646s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:44 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987" returned: 0 in 0.509s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:44 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987 Jul 23 10:37:44 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:44 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487 Jul 23 10:37:44 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:44 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] 58d6a827-3975-4ca7-bb49-103395c10f9c was raw, converting to qcow2 {{(pid=88371) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:44 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 Jul 23 10:37:44 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:44 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-338fcb3f-0979-4cf8-b34d-4086eb4d0987" returned: 0 in 0.333s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-quobyte-338fcb3f-0979-4cf8-b34d-4086eb4d0987" released by "delete_volume" :: held 0.927s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:44 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487" returned: 0 in 0.337s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.115s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-929163138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733a4144-2f8a-4781-b647-85fc3a5b5419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:40Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Creating volume 733a4144-2f8a-4781-b647-85fc3a5b5419 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:44 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:44 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419 1073741824 Jul 23 10:37:44 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337a947e-22e5-40c0-be74-fa45ae583289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e52ca7-4418-423c-b855-45f077d6ea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:44 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487 (2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487): created successfully Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e52ca7-4418-423c-b855-45f077d6ea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (db6f1e42-29a0-4146-8778-bd500e1a60ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:44 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-92f73fb4-d4bf-4efb-9a24-496b15977502 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created volume successfully. Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Created reservations ['c3a93f32-8922-4136-a0fc-3cdba368c10f', '17e6bcc9-b25f-4b50-9e0e-64a1b631df7a', 'ae2e5184-67de-40c5-9f28-b60d27939bf0', '21563597-fc0e-4950-9f09-c57b6049e56b'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:44 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:44 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:44 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2" returned: 0 in 0.639s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58d6a827-3975-4ca7-bb49-103395c10f9c_tone4zfvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:37:44 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 10:37:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:44 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 1G Jul 23 10:37:44 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:45 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.365s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:45 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Deleted volume successfully. Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ad5062f2-19fc-4d1e-ab2e-38ea93241194 tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-338fcb3f-0979-4cf8-b34d-4086eb4d0987-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:45 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419 1073741824" returned: 0 in 0.657s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:45 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419 Jul 23 10:37:45 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:45 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 1G" returned: 0 in 0.414s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Downloaded image 58d6a827-3975-4ca7-bb49-103395c10f9c ((None, [{'url': 'file:///opt/stack/data/glance/images/58d6a827-3975-4ca7-bb49-103395c10f9c', 'metadata': {}}])) to volume f3d787ce-6eda-46e8-97c7-33232634c5b2 successfully. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Temporary image 58d6a827-3975-4ca7-bb49-103395c10f9c for user e9232cca9b764ca697c5269a01895062 is deleted. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Marking volume f3d787ce-6eda-46e8-97c7-33232634c5b2 as bootable. {{(pid=88371) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Copying metadata from image 58d6a827-3975-4ca7-bb49-103395c10f9c to f3d787ce-6eda-46e8-97c7-33232634c5b2. {{(pid=88371) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Creating volume glance metadata for volume f3d787ce-6eda-46e8-97c7-33232634c5b2 backed by image 58d6a827-3975-4ca7-bb49-103395c10f9c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '58d6a827-3975-4ca7-bb49-103395c10f9c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '40c6e81795d22730f31498b92d09a7b9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88371) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 10:37:45 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419" returned: 0 in 0.262s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.747s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1853905966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78196095-022b-4dfb-ae08-e1575d34d450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfea0033afb4c33b953d5f19c4476ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:41Z,use_quota=True,user_id='648cf63f269f4a76b95f021b04197ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Creating volume 78196095-022b-4dfb-ae08-e1575d34d450 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:45 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cd5a34-439c-4b66-9392-fe5cc443cea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d787ce-6eda-46e8-97c7-33232634c5b2', 'volume_size': 1, 'image_id': '58d6a827-3975-4ca7-bb49-103395c10f9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58d6a827-3975-4ca7-bb49-103395c10f9c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40c6e81795d22730f31498b92d09a7b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d3bb6d6039d456ab3d3f16fbd78023f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42e9b352b99800de2d09726d309f2239d1436dd2b93fb5ddd35c288448d382472e149b46089950655c4d9e7a796fb5e5f1339e5b6837ac3e0f9b32fd0ad156f0', 'id': '58d6a827-3975-4ca7-bb49-103395c10f9c', 'created_at': datetime.datetime(2026, 7, 23, 8, 37, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 37, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58d6a827-3975-4ca7-bb49-103395c10f9c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565cc752-a11c-404f-a596-ee7f70438d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:45 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450 1073741824 Jul 23 10:37:45 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5539ce-fc14-409a-80aa-101be9a9e075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733a4144-2f8a-4781-b647-85fc3a5b5419', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cf5b4c-0b4f-4fd4-beb1-45feea99b477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:45 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Volume volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 (f3d787ce-6eda-46e8-97c7-33232634c5b2): created successfully Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565cc752-a11c-404f-a596-ee7f70438d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Flow 'volume_create_manager' (b5257752-9a51-477f-af91-2b075e621c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:45 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume volume-733a4144-2f8a-4781-b647-85fc3a5b5419 (733a4144-2f8a-4781-b647-85fc3a5b5419): created successfully Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cf5b4c-0b4f-4fd4-beb1-45feea99b477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (6646828c-b238-4597-862a-4f66d871af4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:45 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-635bbe19-8fe8-41e8-a0ac-4e5ed9c16a40 tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Created volume successfully. Jul 23 10:37:45 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-06f0a2bf-a6b8-44f2-b356-56ac177d8891 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created volume successfully. Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "cinder-fac3ba25-acb8-4e4d-af0f-32a58f6cf953-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-fac3ba25-acb8-4e4d-af0f-32a58f6cf953-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "cinder-quobyte-fac3ba25-acb8-4e4d-af0f-32a58f6cf953" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-quobyte-fac3ba25-acb8-4e4d-af0f-32a58f6cf953" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[336b5fe3-f55f-4976-9530-ba5e0fa37e11]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:45 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953 Jul 23 10:37:45 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:46 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450 1073741824" returned: 0 in 0.542s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:46 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450 Jul 23 10:37:46 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Acquiring lock "cinder-f3d787ce-6eda-46e8-97c7-33232634c5b2-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Lock "cinder-f3d787ce-6eda-46e8-97c7-33232634c5b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:46 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953" returned: 0 in 0.526s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:46 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953 Jul 23 10:37:46 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:46 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:46 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Acquiring lock "cinder-quobyte-f3d787ce-6eda-46e8-97c7-33232634c5b2" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Lock "cinder-quobyte-f3d787ce-6eda-46e8-97c7-33232634c5b2" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:46 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[61065f56-b2b3-448b-b39c-919a293ad585]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450" returned: 0 in 0.347s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb107027-40d4-468a-a036-17df68c22b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78196095-022b-4dfb-ae08-e1575d34d450', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c5cb40-c00d-4895-897f-c6daafd7630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:46 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Volume volume-78196095-022b-4dfb-ae08-e1575d34d450 (78196095-022b-4dfb-ae08-e1575d34d450): created successfully Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c5cb40-c00d-4895-897f-c6daafd7630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Flow 'volume_create_manager' (1918d5a8-8b1c-4c3e-bfa5-b1967b9cab2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:46 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-84b1965e-6cb9-45b8-a5ac-6d1dfe21bf32 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created volume successfully. Jul 23 10:37:46 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fac3ba25-acb8-4e4d-af0f-32a58f6cf953" returned: 0 in 0.336s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:46 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 Jul 23 10:37:46 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-quobyte-fac3ba25-acb8-4e4d-af0f-32a58f6cf953" released by "delete_volume" :: held 0.921s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:46 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.344s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Created reservations ['179b5998-299f-4bd4-86b1-2bd1f0ada612', '94ef3416-7da4-4c5f-aa63-e38da494490b', '0aa6be05-3a8d-4d87-93f2-1c56c4800983', '11c9c162-f186-43f2-9fbe-2aea5799e343'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:46 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:46 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:46 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2" returned: 0 in 0.536s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:46 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2 Jul 23 10:37:46 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:47 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.324s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:47 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Deleted volume successfully. Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-324cba92-97ab-4022-8ebf-b7550eb841bf tempest-CinderUnicodeTest-1152058452 None] Lock "cinder-fac3ba25-acb8-4e4d-af0f-32a58f6cf953-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:47 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-f3d787ce-6eda-46e8-97c7-33232634c5b2" returned: 0 in 0.306s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Lock "cinder-quobyte-f3d787ce-6eda-46e8-97c7-33232634c5b2" released by "delete_volume" :: held 0.893s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Created reservations ['4c10664c-d833-439c-8147-6a7a9fb599bf', '15a4c8a8-88c0-4620-b18b-ffafda5213e7', '775bf373-e822-4ffe-b54c-039878e21213', '42a55ad4-029c-4ffe-b9d1-dd284299be5b'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-78196095-022b-4dfb-ae08-e1575d34d450-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-78196095-022b-4dfb-ae08-e1575d34d450-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:47 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:47 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-quobyte-78196095-022b-4dfb-ae08-e1575d34d450" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-78196095-022b-4dfb-ae08-e1575d34d450" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e4dc27-ccfa-4b2c-8c63-8c1e582ac314]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:47 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.309s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:47 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450 Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:47 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:47 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Deleted volume successfully. Jul 23 10:37:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e291afde-9cb2-4e2a-adc1-b8ae8449888e tempest-VolumeAndVolumeTypeFromImageTest-2025873453 None] Lock "cinder-f3d787ce-6eda-46e8-97c7-33232634c5b2-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:48 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450" returned: 0 in 0.492s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:48 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450 Jul 23 10:37:48 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:48 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-78196095-022b-4dfb-ae08-e1575d34d450" returned: 0 in 0.258s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-78196095-022b-4dfb-ae08-e1575d34d450" released by "delete_volume" :: held 0.813s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created reservations ['fa268760-a7db-4559-94b3-dcf7b531f04d', 'b87528a3-a9db-4075-888f-62b6eea4349c', '1f7ded7f-a268-4dd8-8317-5c171dfdebdc', 'eab9e158-e1fd-4e77-9ddf-ef3940c22725'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:48 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:48 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-733a4144-2f8a-4781-b647-85fc3a5b5419-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-733a4144-2f8a-4781-b647-85fc3a5b5419-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-quobyte-733a4144-2f8a-4781-b647-85fc3a5b5419" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-733a4144-2f8a-4781-b647-85fc3a5b5419" acquired by "delete_volume" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acedfc8-e334-4354-b685-d97263aac5e5]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:48 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.349s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:48 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Deleted volume successfully. Jul 23 10:37:48 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419 Jul 23 10:37:48 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7073ba4-50cc-4fd0-af7c-c8c6b5d79090 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-78196095-022b-4dfb-ae08-e1575d34d450-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:49 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419" returned: 0 in 0.458s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:49 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419 Jul 23 10:37:49 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:49 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-733a4144-2f8a-4781-b647-85fc3a5b5419" returned: 0 in 0.280s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-733a4144-2f8a-4781-b647-85fc3a5b5419" released by "delete_volume" :: held 0.806s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created reservations ['a24922a1-7530-4dc0-b881-3e25c737b707', '5d69e172-664f-4d9f-9a15-a198f29e3783', 'fd78111c-7259-4465-93aa-7ab2024ace3c', 'cbd99a50-e1fa-43e7-817b-79e1704b816f'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:49 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:49 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-quobyte-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:50 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd490f7-266d-4141-872c-e26807d5b769]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:50 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.392s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:50 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:50 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Deleted volume successfully. Jul 23 10:37:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7985ddf2-eef0-4e08-a7a1-6eafc70c6d55 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-733a4144-2f8a-4781-b647-85fc3a5b5419-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:50 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487 Jul 23 10:37:50 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:50 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487" returned: 0 in 0.453s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:50 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487 Jul 23 10:37:50 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:50 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487" returned: 0 in 0.375s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487" released by "delete_volume" :: held 0.899s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created reservations ['4bc6438e-2481-4e30-ae5c-c1673f76473d', '59e76755-4b71-4263-b2f6-e3b9d9b78341', 'ca0ad649-e494-40b6-a26a-74c84b49c1f6', '8f69aa4e-e7ab-48e8-9098-f960f993e5f7'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:51 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:51 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-50fcf459-57c9-4ef2-a2a4-6917831ba6c6-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-50fcf459-57c9-4ef2-a2a4-6917831ba6c6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-quobyte-50fcf459-57c9-4ef2-a2a4-6917831ba6c6" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-50fcf459-57c9-4ef2-a2a4-6917831ba6c6" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4d3afb-7eb4-4ec2-b735-a756a0241b29]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:51 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.390s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:51 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Deleted volume successfully. Jul 23 10:37:51 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6 Jul 23 10:37:51 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-a1020bb9-7743-49b6-8385-3a0dda5e44c6 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-2d47f2e5-c904-4ee7-9ee2-1a8dc72b6487-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Flow 'volume_create_manager' (640b7495-60f4-4b96-a5ec-42bb5abbd49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ef6705-bbca-4897-addf-df1797d2dea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ef6705-bbca-4897-addf-df1797d2dea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217964479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4b95ab-2670-43cc-9e4e-cea221d82aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56c49beec4747b2ac72c5c63b043d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:52Z,use_quota=True,user_id='d8305d36fd2d44898be4a4a1bcdca485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9dab69-7c8e-4b7b-8759-24534b56234b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9dab69-7c8e-4b7b-8759-24534b56234b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6040dd17-5838-48da-9d95-298390305266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6040dd17-5838-48da-9d95-298390305266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4b95ab-2670-43cc-9e4e-cea221d82aa7', 'volume_name': 'volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a943cf-133a-4613-b487-24571562dd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a943cf-133a-4613-b487-24571562dd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091a737d-57d0-4932-952c-97c2bf7a3c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:51 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Volume bc4b95ab-2670-43cc-9e4e-cea221d82aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7', 'volume_size': 1} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217964479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4b95ab-2670-43cc-9e4e-cea221d82aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56c49beec4747b2ac72c5c63b043d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:52Z,use_quota=True,user_id='d8305d36fd2d44898be4a4a1bcdca485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Creating volume bc4b95ab-2670-43cc-9e4e-cea221d82aa7 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:51 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:51 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 1073741824 Jul 23 10:37:51 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:51 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6" returned: 0 in 0.469s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:51 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6 Jul 23 10:37:51 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:52 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-50fcf459-57c9-4ef2-a2a4-6917831ba6c6" returned: 0 in 0.432s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-50fcf459-57c9-4ef2-a2a4-6917831ba6c6" released by "delete_volume" :: held 0.984s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created reservations ['b34933c4-7143-49d1-94f1-500959c9a62e', '171dd1c2-b28b-4efd-8527-8bf2361cfc65', 'e37c52b9-619c-4149-9aa4-ced1d71e33fd', 'd1939bbf-d332-4190-8aa6-874ceb30dac4'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:52 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 1073741824" returned: 0 in 0.664s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:52 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:52 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:52 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 Jul 23 10:37:52 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:52 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.288s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:52 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Deleted volume successfully. Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d6d9813f-2657-4f78-9428-45e4727907d7 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-50fcf459-57c9-4ef2-a2a4-6917831ba6c6-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:52 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7" returned: 0 in 0.322s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091a737d-57d0-4932-952c-97c2bf7a3c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb33aa2-e90c-42b0-bd29-bc8c02d59444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:52 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Volume volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 (bc4b95ab-2670-43cc-9e4e-cea221d82aa7): created successfully Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb33aa2-e90c-42b0-bd29-bc8c02d59444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:52 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Flow 'volume_create_manager' (640b7495-60f4-4b96-a5ec-42bb5abbd49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:52 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-affd0ab8-8b0a-4420-adb6-0a1c9ad63c28 tempest-ProjectReaderTests-1355507435 None] Created volume successfully. Jul 23 10:37:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-quobyte-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d552dcd-ab25-4add-b9b2-3f62fddbce8a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:53 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7 Jul 23 10:37:53 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] Creating offline snapshot e98f1569-e5fd-4275-9a0a-c000ed056ffe of volume bc4b95ab-2670-43cc-9e4e-cea221d82aa7 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97e6a94-77ee-409d-a040-a00ee24204e9]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:54 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7" returned: 0 in 0.441s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:54 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7 Jul 23 10:37:54 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:54 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 Jul 23 10:37:54 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:54 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7" returned: 0 in 0.300s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7" released by "delete_volume" :: held 0.817s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created reservations ['55ffc9f8-fcc1-406f-8b03-c3af72f8dea7', '1574bd51-5d7a-483c-a76c-5a4bd36eb1ef', '7f8e09b3-ac70-4fa3-8fb8-febc51b0402e', '87337020-541c-4fb5-a456-ad0f08ce8764'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:54 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7" returned: 0 in 0.514s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:54 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe 1G Jul 23 10:37:54 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-0330e094-fb8b-449e-ba0f-6c4dddbdbaf5-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:54 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:54 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-0330e094-fb8b-449e-ba0f-6c4dddbdbaf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-quobyte-9a282e50-06ae-4ab8-9093-321a9a80f180" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Flow 'volume_create_manager' (2696fe97-e7b8-4eb6-843e-dd32e5f31b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fecfbff-5032-4a1f-a3dc-f8aa6283ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fecfbff-5032-4a1f-a3dc-f8aa6283ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333490335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66dd3a81-a04b-458d-8ea1-649114a498bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ad23a57d77416e9aff19f24c516e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:55Z,use_quota=True,user_id='ab1a3977ff03422f8079f45c1d2dad01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db48c1b9-462a-45ea-abc6-d9cacdb36989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db48c1b9-462a-45ea-abc6-d9cacdb36989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac677e1a-c26d-4865-8e24-57056e2dbfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac677e1a-c26d-4865-8e24-57056e2dbfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66dd3a81-a04b-458d-8ea1-649114a498bd', 'volume_name': 'volume-66dd3a81-a04b-458d-8ea1-649114a498bd', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4a7f5c-9148-4d6b-b640-3a08e58ee60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4a7f5c-9148-4d6b-b640-3a08e58ee60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f0fcdb-0896-4ee4-afa0-46e2bf08be2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:54 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Volume 66dd3a81-a04b-458d-8ea1-649114a498bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66dd3a81-a04b-458d-8ea1-649114a498bd', 'volume_size': 1} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-9a282e50-06ae-4ab8-9093-321a9a80f180" acquired by "delete_snapshot" :: waited 0.137s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-quobyte-0330e094-fb8b-449e-ba0f-6c4dddbdbaf5" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-0330e094-fb8b-449e-ba0f-6c4dddbdbaf5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Deleting offline snapshot 0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 of volume 9a282e50-06ae-4ab8-9093-321a9a80f180 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] snapshot_file for this snap is: volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e2a061-9bf7-40c2-8938-0f775412e0c0]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:55 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.389s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Deleted volume successfully. Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-54e9933f-8d8d-4921-bf9b-5808e65f8f0d tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-ee81b2d9-2b5b-4533-8fa3-7ea4a25d61d7-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:55 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 Jul 23 10:37:55 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:55 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe 1G" returned: 0 in 0.722s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:55 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:55 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Flow 'volume_create_manager' (0e938c81-9e68-49eb-a75d-b3c9d3ccbdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a9ba7b-0f5b-4ee3-9ac1-59c8fa0a79c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a9ba7b-0f5b-4ee3-9ac1-59c8fa0a79c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-479678533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b2c88c-782d-49ed-9bef-bfeab88eceb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ad23a57d77416e9aff19f24c516e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:55Z,use_quota=True,user_id='ab1a3977ff03422f8079f45c1d2dad01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3115b4-b810-4a05-880f-b02595a04823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3115b4-b810-4a05-880f-b02595a04823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3eb8a4-916d-45c9-8a9e-dc15ed7182cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3eb8a4-916d-45c9-8a9e-dc15ed7182cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b2c88c-782d-49ed-9bef-bfeab88eceb5', 'volume_name': 'volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a038e0bc-ac51-499c-b98a-12ff6367f00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a038e0bc-ac51-499c-b98a-12ff6367f00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4e10f2-db83-4fec-be6b-07a5af13ba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:55 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Volume 38b2c88c-782d-49ed-9bef-bfeab88eceb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5', 'volume_size': 1} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:55 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5" returned: 0 in 0.492s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a282e50-06ae-4ab8-9093-321a9a80f180(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee473f3-4b50-49d1-9700-9a8c441963ea]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:55 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 Jul 23 10:37:55 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:55 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe" returned: 0 in 0.406s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:55 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe is being set with open permissions: ugo+rw Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:55 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe Jul 23 10:37:55 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Flow 'volume_create_manager' (efd3a47e-7a01-49d5-8aab-29793ac6c7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:55 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3cb8a4-46f9-496c-b4c0-1418627f013c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3cb8a4-46f9-496c-b4c0-1418627f013c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-842844533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2a27cf-7f1a-468f-b989-688d722fff8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ad23a57d77416e9aff19f24c516e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:56Z,use_quota=True,user_id='ab1a3977ff03422f8079f45c1d2dad01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bd6b6e-4159-4d1a-bcfb-6444c76854ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bd6b6e-4159-4d1a-bcfb-6444c76854ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e96188-fcd2-4942-9ced-4eaa4da0cbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e96188-fcd2-4942-9ced-4eaa4da0cbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2a27cf-7f1a-468f-b989-688d722fff8b', 'volume_name': 'volume-db2a27cf-7f1a-468f-b989-688d722fff8b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5134e90c-1610-47a9-93e4-99c5161697d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5134e90c-1610-47a9-93e4-99c5161697d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4090f24b-f350-495d-a40c-76238b2f9e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Volume db2a27cf-7f1a-468f-b989-688d722fff8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2a27cf-7f1a-468f-b989-688d722fff8b', 'volume_size': 1} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180" returned: 0 in 0.609s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:56 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 Jul 23 10:37:56 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:56 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe" returned: 0 in 0.574s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:56 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.info Jul 23 10:37:56 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Flow 'volume_create_manager' (8fcad8d9-43ff-42d4-874c-50f6c694ba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9eadc0-3053-4659-baa8-0d71435d9ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9eadc0-3053-4659-baa8-0d71435d9ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084082436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c115f1-57a9-4efe-b85c-7f8992090e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ad23a57d77416e9aff19f24c516e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:56Z,use_quota=True,user_id='ab1a3977ff03422f8079f45c1d2dad01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ca529f-ac2d-4f2b-a250-b8dd7f82ced8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ca529f-ac2d-4f2b-a250-b8dd7f82ced8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659ff929-2407-4614-a5d2-d04a08679082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659ff929-2407-4614-a5d2-d04a08679082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c115f1-57a9-4efe-b85c-7f8992090e38', 'volume_name': 'volume-23c115f1-57a9-4efe-b85c-7f8992090e38', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446bf97b-1b65-448d-810b-5f6c460fbbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446bf97b-1b65-448d-810b-5f6c460fbbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f3096a-037f-48fa-bb6e-6ad34884621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Volume 23c115f1-57a9-4efe-b85c-7f8992090e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c115f1-57a9-4efe-b85c-7f8992090e38', 'volume_size': 1} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:56 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Flow 'volume_create_manager' (ced7a6dc-08ed-4689-8b1c-4831759230e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e8fecb-16d7-43a9-8969-b2915ab2e802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.info" returned: 0 in 0.448s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:56 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.info is being set with open permissions: ugo+rw Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e8fecb-16d7-43a9-8969-b2915ab2e802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1510690457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ad23a57d77416e9aff19f24c516e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:57Z,use_quota=True,user_id='ab1a3977ff03422f8079f45c1d2dad01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf151be-4a0c-420a-829a-197ac1355940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf151be-4a0c-420a-829a-197ac1355940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.info Jul 23 10:37:56 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d47a7b-17a1-4208-8acd-c1fc0ea45bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d47a7b-17a1-4208-8acd-c1fc0ea45bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf', 'volume_name': 'volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718853f3-a957-447e-9fc0-60eb83358a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718853f3-a957-447e-9fc0-60eb83358a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836e0abb-c5b2-48e8-9702-4576ccff61a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:56 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Volume 2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf', 'volume_size': 1} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5" returned: 0 in 0.693s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:56 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5 Jul 23 10:37:56 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:57 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.info" returned: 0 in 0.267s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.041s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.153s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333490335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66dd3a81-a04b-458d-8ea1-649114a498bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ad23a57d77416e9aff19f24c516e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:55Z,use_quota=True,user_id='ab1a3977ff03422f8079f45c1d2dad01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Creating volume 66dd3a81-a04b-458d-8ea1-649114a498bd {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:57 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:57 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:57 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd 1073741824 Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180.0330e094-fb8b-449e-ba0f-6c4dddbdbaf5" returned: 0 in 0.261s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:57 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5592d568-09b8-49e1-9c09-84ab50400213 tempest-ProjectReaderTests-1355507435 None] Create snapshot completed successfully Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-0330e094-fb8b-449e-ba0f-6c4dddbdbaf5" released by "_delete_snapshot" :: held 2.222s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-9a282e50-06ae-4ab8-9093-321a9a80f180" released by "delete_snapshot" :: held 2.265s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created reservations ['6794c1cf-f30b-4e42-b5b0-0dfa9e6c12a2', '766bebd8-8e51-423f-a308-2ffdf4f003aa', '292f920b-bc6b-4f52-8f74-66054d1a5415', '33fa1b08-ccb4-4b9b-851f-e2c9cacb64f7'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Delete snapshot completed successfully. Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-57b9f489-be51-48d1-a9cc-396042c0c40e tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-0330e094-fb8b-449e-ba0f-6c4dddbdbaf5-delete_snapshot" released by "delete_snapshot" :: held 2.661s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-e98f1569-e5fd-4275-9a0a-c000ed056ffe-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-e98f1569-e5fd-4275-9a0a-c000ed056ffe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-bc4b95ab-2670-43cc-9e4e-cea221d82aa7" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-bc4b95ab-2670-43cc-9e4e-cea221d82aa7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-e98f1569-e5fd-4275-9a0a-c000ed056ffe" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-e98f1569-e5fd-4275-9a0a-c000ed056ffe" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Deleting offline snapshot e98f1569-e5fd-4275-9a0a-c000ed056ffe of volume bc4b95ab-2670-43cc-9e4e-cea221d82aa7 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] snapshot_file for this snap is: volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[80efab9f-2960-48bb-86ed-7b7cd2324ca6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:57 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd 1073741824" returned: 0 in 0.631s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:57 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe Jul 23 10:37:57 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:37:57 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd Jul 23 10:37:57 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Flow 'volume_create_manager' (70087b72-55c6-46dc-8703-c0b29cbc604c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ff8870-6e12-482e-a0ee-7d32fda01c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ff8870-6e12-482e-a0ee-7d32fda01c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-267520025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab53916-71d9-4186-b66e-c6fb95546c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ee2e30f5844ab297c657f361e75ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:58Z,use_quota=True,user_id='75e1032617dd4f269ec63b62ecb33aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deef41ec-f700-41b1-844f-c2d33c62c2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deef41ec-f700-41b1-844f-c2d33c62c2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2a3705-6ebc-4667-a8fa-09436a2170b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2a3705-6ebc-4667-a8fa-09436a2170b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab53916-71d9-4186-b66e-c6fb95546c59', 'volume_name': 'volume-0ab53916-71d9-4186-b66e-c6fb95546c59', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da3b2ce-fda6-4d73-9f3d-a661fb88a1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da3b2ce-fda6-4d73-9f3d-a661fb88a1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a729fd-97d5-457f-9d4f-c014ed4b85c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:57 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Volume 0ab53916-71d9-4186-b66e-c6fb95546c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab53916-71d9-4186-b66e-c6fb95546c59', 'volume_size': 1} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-9a282e50-06ae-4ab8-9093-321a9a80f180-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-9a282e50-06ae-4ab8-9093-321a9a80f180-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "cinder-quobyte-9a282e50-06ae-4ab8-9093-321a9a80f180" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-9a282e50-06ae-4ab8-9093-321a9a80f180" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:58 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe" returned: 0 in 0.399s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:37:58 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d42d4b7-ff1a-46e5-9863-4b8cad6038a4]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5422a234-aaad-4617-86af-ca9065f88f9d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd" returned: 0 in 0.350s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.634s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-479678533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b2c88c-782d-49ed-9bef-bfeab88eceb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ad23a57d77416e9aff19f24c516e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:55Z,use_quota=True,user_id='ab1a3977ff03422f8079f45c1d2dad01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Creating volume 38b2c88c-782d-49ed-9bef-bfeab88eceb5 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:58 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f0fcdb-0896-4ee4-afa0-46e2bf08be2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66dd3a81-a04b-458d-8ea1-649114a498bd', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b3a5aa-38ad-4965-908d-0b3949fffc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:58 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5 1073741824 Jul 23 10:37:58 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:58 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Volume volume-66dd3a81-a04b-458d-8ea1-649114a498bd (66dd3a81-a04b-458d-8ea1-649114a498bd): created successfully Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b3a5aa-38ad-4965-908d-0b3949fffc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Flow 'volume_create_manager' (2696fe97-e7b8-4eb6-843e-dd32e5f31b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:58 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a12c302f-a4eb-4a1c-9dfb-96738646eb45 tempest-CreateVolumesFromImageTest-1909693080 None] Created volume successfully. Jul 23 10:37:58 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 Jul 23 10:37:58 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:58 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 Jul 23 10:37:58 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:58 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180" returned: 0 in 0.376s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:58 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180 Jul 23 10:37:58 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:58 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7" returned: 0 in 0.402s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:58 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe Jul 23 10:37:58 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:58 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5 1073741824" returned: 0 in 0.499s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:58 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5 Jul 23 10:37:58 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:58 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9a282e50-06ae-4ab8-9093-321a9a80f180" returned: 0 in 0.322s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-quobyte-9a282e50-06ae-4ab8-9093-321a9a80f180" released by "delete_volume" :: held 0.783s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Created reservations ['17e175b4-d4e1-4b2d-b9bc-bb3cef0cafa1', '61d4f476-3e1a-447c-84a5-38c731ed26eb', '88fdb3b3-452c-429b-b11f-f0f93b460756', 'd96b2649-babc-4fbc-b825-33f716df4d01'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:58 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe" returned: 0 in 0.420s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:58 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe Jul 23 10:37:58 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:58 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:37:58 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:59 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5" returned: 0 in 0.347s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.882s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-842844533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2a27cf-7f1a-468f-b989-688d722fff8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ad23a57d77416e9aff19f24c516e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:56Z,use_quota=True,user_id='ab1a3977ff03422f8079f45c1d2dad01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Creating volume db2a27cf-7f1a-468f-b989-688d722fff8b {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:59 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4e10f2-db83-4fec-be6b-07a5af13ba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5227bb79-b48a-4fd4-a36e-31740917ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:59 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b 1073741824 Jul 23 10:37:59 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Volume volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5 (38b2c88c-782d-49ed-9bef-bfeab88eceb5): created successfully Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5227bb79-b48a-4fd4-a36e-31740917ead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Flow 'volume_create_manager' (0e938c81-9e68-49eb-a75d-b3c9d3ccbdb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:37:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-2e1b6b05-61bb-4786-9f7e-f65b23c54c74 tempest-CreateVolumesFromImageTest-1909693080 None] Created volume successfully. Jul 23 10:37:59 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7.e98f1569-e5fd-4275-9a0a-c000ed056ffe" returned: 0 in 0.277s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-e98f1569-e5fd-4275-9a0a-c000ed056ffe" released by "_delete_snapshot" :: held 1.615s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-bc4b95ab-2670-43cc-9e4e-cea221d82aa7" released by "delete_snapshot" :: held 1.652s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Created reservations ['0a1584a3-880d-4e32-9a48-276d695ea62c', '08f4c19e-d70d-4634-932c-37d96ec09f8b', '7b466d16-134d-4bf8-a8ab-286a03fdda1b', 'ae8466ca-3043-46c8-8762-946a5ad02f85'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:37:59 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.359s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:37:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Deleted volume successfully. Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1889aa08-9299-47fc-8ba1-4c91e695dd90 tempest-CreateVolumesFromSnapshotTest-1857323136 None] Lock "cinder-9a282e50-06ae-4ab8-9093-321a9a80f180-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Delete snapshot completed successfully. Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-e31fbe89-1eac-4783-8f3a-617de65edc50 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-e98f1569-e5fd-4275-9a0a-c000ed056ffe-delete_snapshot" released by "delete_snapshot" :: held 1.822s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:37:59 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b 1073741824" returned: 0 in 0.520s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:59 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b Jul 23 10:37:59 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-bc4b95ab-2670-43cc-9e4e-cea221d82aa7-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Lock "cinder-bc4b95ab-2670-43cc-9e4e-cea221d82aa7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-bc4b95ab-2670-43cc-9e4e-cea221d82aa7" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-bc4b95ab-2670-43cc-9e4e-cea221d82aa7" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:37:59 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b" returned: 0 in 0.302s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.316s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084082436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c115f1-57a9-4efe-b85c-7f8992090e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ad23a57d77416e9aff19f24c516e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:56Z,use_quota=True,user_id='ab1a3977ff03422f8079f45c1d2dad01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Creating volume 23c115f1-57a9-4efe-b85c-7f8992090e38 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:37:59 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a462535e-6032-4e29-b14f-8ae4e348f9a5]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:37:59 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38 1073741824 Jul 23 10:37:59 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4090f24b-f350-495d-a40c-76238b2f9e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2a27cf-7f1a-468f-b989-688d722fff8b', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a81141-51ba-4bf6-bf3c-1dc54fd6c811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:37:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Volume volume-db2a27cf-7f1a-468f-b989-688d722fff8b (db2a27cf-7f1a-468f-b989-688d722fff8b): created successfully Jul 23 10:37:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a81141-51ba-4bf6-bf3c-1dc54fd6c811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Flow 'volume_create_manager' (efd3a47e-7a01-49d5-8aab-29793ac6c7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-25cf4f5e-172e-4f68-8f91-45fba339ba84 tempest-CreateVolumesFromImageTest-1909693080 None] Created volume successfully. Jul 23 10:38:00 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 Jul 23 10:38:00 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:00 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7" returned: 0 in 0.478s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:00 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7 Jul 23 10:38:00 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:00 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38 1073741824" returned: 0 in 0.546s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:00 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38 Jul 23 10:38:00 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:00 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bc4b95ab-2670-43cc-9e4e-cea221d82aa7" returned: 0 in 0.272s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-bc4b95ab-2670-43cc-9e4e-cea221d82aa7" released by "delete_volume" :: held 0.857s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:00 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Created reservations ['9baf10dd-8cd7-423e-91d9-177a219acd07', '1cf5ada9-2866-4dfc-bc3f-b9729f7d69c8', '88ab4fdf-4c10-4e9a-9e76-c2b1dce531f7', '232f32e2-121f-40cf-9289-9d222c7d28be'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38" returned: 0 in 0.269s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.938s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1510690457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ad23a57d77416e9aff19f24c516e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:57Z,use_quota=True,user_id='ab1a3977ff03422f8079f45c1d2dad01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Creating volume 2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:00 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f3096a-037f-48fa-bb6e-6ad34884621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c115f1-57a9-4efe-b85c-7f8992090e38', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:00 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf 1073741824 Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e97f8f-f9e4-45e9-b630-f68a668fbfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:00 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:00 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Volume volume-23c115f1-57a9-4efe-b85c-7f8992090e38 (23c115f1-57a9-4efe-b85c-7f8992090e38): created successfully Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e97f8f-f9e4-45e9-b630-f68a668fbfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Flow 'volume_create_manager' (8fcad8d9-43ff-42d4-874c-50f6c694ba21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:00 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7bf7396f-f1a4-4e76-a9ee-c5daaf5ab61d tempest-CreateVolumesFromImageTest-1909693080 None] Created volume successfully. Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:01 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:01 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:01 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.322s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Deleted volume successfully. Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-513d301a-959b-4679-ab22-45b1a5bb886e tempest-ProjectReaderTests-1355507435 None] Lock "cinder-bc4b95ab-2670-43cc-9e4e-cea221d82aa7-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:01 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf 1073741824" returned: 0 in 0.592s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:01 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf Jul 23 10:38:01 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:01 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf" returned: 0 in 0.257s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.815s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-267520025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab53916-71d9-4186-b66e-c6fb95546c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ee2e30f5844ab297c657f361e75ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:37:58Z,use_quota=True,user_id='75e1032617dd4f269ec63b62ecb33aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Creating volume 0ab53916-71d9-4186-b66e-c6fb95546c59 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:01 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:01 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59 1073741824 Jul 23 10:38:01 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836e0abb-c5b2-48e8-9702-4576ccff61a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bfb3b2-35e2-4b86-97d4-8dc1a549c7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:01 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Volume volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf (2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf): created successfully Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bfb3b2-35e2-4b86-97d4-8dc1a549c7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:01 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Flow 'volume_create_manager' (ced7a6dc-08ed-4689-8b1c-4831759230e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a38a293a-4278-4e29-b046-04a032513673 tempest-CreateVolumesFromImageTest-1909693080 None] Created volume successfully. Jul 23 10:38:02 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59 1073741824" returned: 0 in 0.525s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:02 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59 Jul 23 10:38:02 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "cinder-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "cinder-quobyte-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-quobyte-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8553385-71d1-4852-893e-39d55c5225e4]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:02 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59" returned: 0 in 0.358s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a729fd-97d5-457f-9d4f-c014ed4b85c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab53916-71d9-4186-b66e-c6fb95546c59', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a936fb0-1ec9-4dcc-8ff5-be14b41ea971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:02 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf Jul 23 10:38:02 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:02 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Volume volume-0ab53916-71d9-4186-b66e-c6fb95546c59 (0ab53916-71d9-4186-b66e-c6fb95546c59): created successfully Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a936fb0-1ec9-4dcc-8ff5-be14b41ea971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Flow 'volume_create_manager' (70087b72-55c6-46dc-8703-c0b29cbc604c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (93fb1824-a1ec-4313-80f7-e6435fd0ff93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90174f7-eba3-494d-af25-a7ff8d272970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90174f7-eba3-494d-af25-a7ff8d272970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1182557950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ad7da0-81d4-4075-a20a-5b4a6f257f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:03Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66130fb-6983-4ca8-bc92-6f0322ea5a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66130fb-6983-4ca8-bc92-6f0322ea5a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857851f0-78d1-4c2c-882c-28a9ad911eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857851f0-78d1-4c2c-882c-28a9ad911eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ad7da0-81d4-4075-a20a-5b4a6f257f23', 'volume_name': 'volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b6f63b-64d0-42bc-9131-da42d425c878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b6f63b-64d0-42bc-9131-da42d425c878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6a7c97-ad36-4e18-85de-fc14638cd84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:02 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume e4ad7da0-81d4-4075-a20a-5b4a6f257f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23', 'volume_size': 1} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1182557950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ad7da0-81d4-4075-a20a-5b4a6f257f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:03Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Creating volume e4ad7da0-81d4-4075-a20a-5b4a6f257f23 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:02 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:02 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-19e349e6-5e6d-4b67-860f-13c2ccf8bcdf tempest-ProjectReaderTests-1170334319 None] Created volume successfully. Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:02 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23 1073741824 Jul 23 10:38:02 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Flow 'volume_create_manager' (600211b7-91af-4b63-9bbe-9f18bccc186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90f80b9-28f2-4a6d-9925-ba366397dfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90f80b9-28f2-4a6d-9925-ba366397dfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-612101220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2031d4ad-d087-4969-932d-6d9f7092a6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56c49beec4747b2ac72c5c63b043d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:03Z,use_quota=True,user_id='d8305d36fd2d44898be4a4a1bcdca485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:02 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e76dd90-c2c7-4e8a-a712-da7b9b2d47f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e76dd90-c2c7-4e8a-a712-da7b9b2d47f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9dba96-95a5-488b-96e3-1027cdcaadbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9dba96-95a5-488b-96e3-1027cdcaadbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2031d4ad-d087-4969-932d-6d9f7092a6e2', 'volume_name': 'volume-2031d4ad-d087-4969-932d-6d9f7092a6e2', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1b3429-2909-4d5d-a444-97dc996fe22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1b3429-2909-4d5d-a444-97dc996fe22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def38b88-6039-4e75-a2ed-bd768a81f72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:03 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Volume 2031d4ad-d087-4969-932d-6d9f7092a6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2031d4ad-d087-4969-932d-6d9f7092a6e2', 'volume_size': 1} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:03 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf" returned: 0 in 0.438s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:03 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf Jul 23 10:38:03 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Acquiring lock "cinder-0ab53916-71d9-4186-b66e-c6fb95546c59-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-0ab53916-71d9-4186-b66e-c6fb95546c59-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Acquiring lock "cinder-quobyte-0ab53916-71d9-4186-b66e-c6fb95546c59" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-quobyte-0ab53916-71d9-4186-b66e-c6fb95546c59" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5a2b9f-f5f1-48b1-bd72-82297b1c6207]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:03 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf" returned: 0 in 0.318s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-quobyte-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf" released by "delete_volume" :: held 0.806s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:03 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23 1073741824" returned: 0 in 0.498s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Created reservations ['6e683ada-3e6b-4e9f-b7a9-d8e91e03f0ab', 'a9f172d5-fbdf-4f18-9f6d-f69d736bc8e8', '5d51e235-e0e0-40b2-978d-63e065f01841', '23efe283-dd5c-4fe1-82e8-5603a7280a40'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:03 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59 Jul 23 10:38:03 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:03 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23 Jul 23 10:38:03 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:03 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:03 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "cinder-23c115f1-57a9-4efe-b85c-7f8992090e38-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:03 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23" returned: 0 in 0.296s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.722s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-612101220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2031d4ad-d087-4969-932d-6d9f7092a6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56c49beec4747b2ac72c5c63b043d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:03Z,use_quota=True,user_id='d8305d36fd2d44898be4a4a1bcdca485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Creating volume 2031d4ad-d087-4969-932d-6d9f7092a6e2 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:03 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:03 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59" returned: 0 in 0.454s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-23c115f1-57a9-4efe-b85c-7f8992090e38-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:03 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 1073741824 Jul 23 10:38:03 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59 Jul 23 10:38:03 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:03 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6a7c97-ad36-4e18-85de-fc14638cd84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca84a004-2ed5-4024-88b8-e9629ad0ba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:03 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23 (e4ad7da0-81d4-4075-a20a-5b4a6f257f23): created successfully Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca84a004-2ed5-4024-88b8-e9629ad0ba2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:03 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (93fb1824-a1ec-4313-80f7-e6435fd0ff93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.320s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:03 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Deleted volume successfully. Jul 23 10:38:03 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ef7aadb9-7739-4549-b5de-cbb2e43d0d38 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created volume successfully. Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "cinder-quobyte-23c115f1-57a9-4efe-b85c-7f8992090e38" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-quobyte-23c115f1-57a9-4efe-b85c-7f8992090e38" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e6331f1-7ad1-40ac-89eb-4b79a1bead61 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-2ea7d5ae-7f35-4cd8-a749-1c8cb31fbabf-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7ea397-1a98-4b40-a484-9943884d8f86]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:04 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:04 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38 Jul 23 10:38:04 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-0ab53916-71d9-4186-b66e-c6fb95546c59" returned: 0 in 0.299s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-quobyte-0ab53916-71d9-4186-b66e-c6fb95546c59" released by "delete_volume" :: held 0.797s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Created reservations ['760fc12e-6f8b-440e-9220-5625df59f249', 'd65acbbe-9fdd-419a-b221-57f8e479634a', 'ca8d7850-b105-443d-a922-6ecf051aea2d', '725a22bb-ca42-4d7c-9fe0-ee37147bc351'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:04 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:04 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:04 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 1073741824" returned: 0 in 0.548s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:04 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38" returned: 0 in 0.421s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:04 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 Jul 23 10:38:04 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:04 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38 Jul 23 10:38:04 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:04 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.305s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Deleted volume successfully. Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4022004e-1a0c-4a8b-9b8b-3924e48889f4 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-0ab53916-71d9-4186-b66e-c6fb95546c59-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:04 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2" returned: 0 in 0.321s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def38b88-6039-4e75-a2ed-bd768a81f72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2031d4ad-d087-4969-932d-6d9f7092a6e2', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:04 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94d8043-bb94-4c96-bb77-0f4167583d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-23c115f1-57a9-4efe-b85c-7f8992090e38" returned: 0 in 0.329s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-quobyte-23c115f1-57a9-4efe-b85c-7f8992090e38" released by "delete_volume" :: held 0.803s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:04 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Volume volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 (2031d4ad-d087-4969-932d-6d9f7092a6e2): created successfully Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94d8043-bb94-4c96-bb77-0f4167583d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Flow 'volume_create_manager' (600211b7-91af-4b63-9bbe-9f18bccc186c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:04 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-76558090-ffa8-4cc7-8747-b9a5c8a3bb6b tempest-ProjectReaderTests-1355507435 None] Created volume successfully. Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Created reservations ['cb4ede3b-0e25-4028-935c-c2f96c3ec828', '5ba58570-523b-4529-ae61-6e2f5b9568cb', '89b765cd-5ced-4eab-9f27-0f19af8d5aee', '17556fed-a058-465e-95e2-db7563c785a6'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "cinder-db2a27cf-7f1a-468f-b989-688d722fff8b-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:05 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-db2a27cf-7f1a-468f-b989-688d722fff8b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:05 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Flow 'volume_create_manager' (eaa1dbee-194a-410e-af67-5c787d619eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bdcf37-7494-45fd-9ec5-a9f59669f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bdcf37-7494-45fd-9ec5-a9f59669f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010865267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6dec1d-7427-4b3a-bcc5-03b7dcec4910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ee2e30f5844ab297c657f361e75ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:05Z,use_quota=True,user_id='75e1032617dd4f269ec63b62ecb33aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a7e7e0-b916-465f-ace3-231147bd4f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a7e7e0-b916-465f-ace3-231147bd4f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c077987b-3b4e-46aa-b96b-d52336715f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c077987b-3b4e-46aa-b96b-d52336715f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6dec1d-7427-4b3a-bcc5-03b7dcec4910', 'volume_name': 'volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0add94-87e4-4c3e-8799-d69520bbe167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0add94-87e4-4c3e-8799-d69520bbe167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb5f232-bb2e-4801-9163-cc8b411e280d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Volume cf6dec1d-7427-4b3a-bcc5-03b7dcec4910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910', 'volume_size': 1} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010865267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6dec1d-7427-4b3a-bcc5-03b7dcec4910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ee2e30f5844ab297c657f361e75ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:05Z,use_quota=True,user_id='75e1032617dd4f269ec63b62ecb33aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Creating volume cf6dec1d-7427-4b3a-bcc5-03b7dcec4910 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:05 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:05 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910 1073741824 Jul 23 10:38:05 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "cinder-quobyte-db2a27cf-7f1a-468f-b989-688d722fff8b" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-quobyte-db2a27cf-7f1a-468f-b989-688d722fff8b" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:05 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef91ff05-13b4-4d1a-b501-33ec587292ed]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.337s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:05 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Deleted volume successfully. Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0febe4d2-f661-43a9-9070-7c36af6659cf tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-23c115f1-57a9-4efe-b85c-7f8992090e38-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (5c65e3fa-e2ef-43ce-86ef-86dbef5892b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1d41bc-1397-4812-bd67-37548bb9c806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1d41bc-1397-4812-bd67-37548bb9c806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1253069944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ec3f0c-72ed-4fda-b466-48e4cd9a2346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:05Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:05 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b Jul 23 10:38:05 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50a99f0-cc3e-4dc1-81ec-ef1eebfc4996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50a99f0-cc3e-4dc1-81ec-ef1eebfc4996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6658fda3-ddf1-4530-b91a-f4659ac14b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6658fda3-ddf1-4530-b91a-f4659ac14b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ec3f0c-72ed-4fda-b466-48e4cd9a2346', 'volume_name': 'volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5f97e1-3b68-4166-8a13-21dd0f6fae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5f97e1-3b68-4166-8a13-21dd0f6fae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d119f3-609a-40e1-9182-57ca55873fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume b1ec3f0c-72ed-4fda-b466-48e4cd9a2346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346', 'volume_size': 1} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:05 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910 1073741824" returned: 0 in 0.550s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:05 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:05 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910 Jul 23 10:38:05 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b" returned: 0 in 0.539s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:05 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b Jul 23 10:38:05 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (bc9ec74f-b978-43aa-81cd-2a68ea69b9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f888d96-ea71-4413-bd7c-cbf89f874a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f888d96-ea71-4413-bd7c-cbf89f874a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301525609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf95d436-81a2-4ea1-bd65-389b27c329d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:06Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616ea0c9-02d9-47ff-8780-0ee23503e3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616ea0c9-02d9-47ff-8780-0ee23503e3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:05 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5389941-8a0d-4e68-8aba-0b199e3206d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5389941-8a0d-4e68-8aba-0b199e3206d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf95d436-81a2-4ea1-bd65-389b27c329d2', 'volume_name': 'volume-bf95d436-81a2-4ea1-bd65-389b27c329d2', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12c0df1-e5fe-4bec-9214-3a0e292776b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12c0df1-e5fe-4bec-9214-3a0e292776b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e71454-74c5-4bb5-863b-e3a2cda8b25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume bf95d436-81a2-4ea1-bd65-389b27c329d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf95d436-81a2-4ea1-bd65-389b27c329d2', 'volume_size': 1} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:06 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910" returned: 0 in 0.376s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1253069944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ec3f0c-72ed-4fda-b466-48e4cd9a2346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:05Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Creating volume b1ec3f0c-72ed-4fda-b466-48e4cd9a2346 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:06 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb5f232-bb2e-4801-9163-cc8b411e280d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdefc909-0098-4c32-9196-2ccba07f5430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346 1073741824 Jul 23 10:38:06 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:06 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Volume volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910 (cf6dec1d-7427-4b3a-bcc5-03b7dcec4910): created successfully Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdefc909-0098-4c32-9196-2ccba07f5430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Flow 'volume_create_manager' (eaa1dbee-194a-410e-af67-5c787d619eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:06 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f03dd8e9-c357-4c56-a089-4eae07a3e88c tempest-ProjectReaderTests-1170334319 None] Created volume successfully. Jul 23 10:38:06 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-db2a27cf-7f1a-468f-b989-688d722fff8b" returned: 0 in 0.422s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-quobyte-db2a27cf-7f1a-468f-b989-688d722fff8b" released by "delete_volume" :: held 1.032s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Created reservations ['84caf919-67d3-445b-94ed-9d9e13ed24c1', '7ca8a530-cbe9-4765-8ca4-e6cb3cb7bd2b', '29e9f18c-c39e-4166-a6a7-3c7ed5377fd0', '2ca39997-6ff8-40d4-8123-9a6658e6ff27'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (b5e47f79-3806-4000-afea-cc82cc225bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96de088c-280a-4b5a-85d7-403f00017541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96de088c-280a-4b5a-85d7-403f00017541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1339400304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a576b3ca-a57b-48f5-be6c-075c49b94a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:06Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4232029-6425-4c13-af71-6a69d1ae75f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4232029-6425-4c13-af71-6a69d1ae75f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c5c1e3-8527-4e3f-861f-46ec9686325d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c5c1e3-8527-4e3f-861f-46ec9686325d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a576b3ca-a57b-48f5-be6c-075c49b94a08', 'volume_name': 'volume-a576b3ca-a57b-48f5-be6c-075c49b94a08', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea1fbde-515f-4a9f-8e03-38e76063f7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea1fbde-515f-4a9f-8e03-38e76063f7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e291e6bd-50ab-4fc2-b5b4-812a084f8c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume a576b3ca-a57b-48f5-be6c-075c49b94a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a576b3ca-a57b-48f5-be6c-075c49b94a08', 'volume_size': 1} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:06 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:06 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:06 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346 1073741824" returned: 0 in 0.512s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:06 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346 Jul 23 10:38:06 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:06 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (2087fd14-6c34-452a-8ae7-0a28c86f2519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94268287-71cf-4c11-b01b-510ee8bc272c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.339s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94268287-71cf-4c11-b01b-510ee8bc272c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570549228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96dbd28-3e5b-4dfc-8366-7bcbc403ac70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:07Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cafd30-75a9-4831-b0e9-2b7d3c1b2dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cafd30-75a9-4831-b0e9-2b7d3c1b2dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8180883-017f-4bc6-85be-7d22a845a296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8180883-017f-4bc6-85be-7d22a845a296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96dbd28-3e5b-4dfc-8366-7bcbc403ac70', 'volume_name': 'volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f303062-5034-41ce-aae8-028d1f8bd1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f303062-5034-41ce-aae8-028d1f8bd1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2b6b45-a72d-4551-8533-b5a951f09657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:06 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume b96dbd28-3e5b-4dfc-8366-7bcbc403ac70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70', 'volume_size': 1} Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:06 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Deleted volume successfully. Jul 23 10:38:06 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebd1b45d-e9ad-4119-b957-542ad547cef6 tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-db2a27cf-7f1a-468f-b989-688d722fff8b-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:07 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346" returned: 0 in 0.315s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301525609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf95d436-81a2-4ea1-bd65-389b27c329d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:06Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Creating volume bf95d436-81a2-4ea1-bd65-389b27c329d2 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:07 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d119f3-609a-40e1-9182-57ca55873fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:07 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2 1073741824 Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfb9c08-70e7-4886-a93c-41c463280c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:07 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:07 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346 (b1ec3f0c-72ed-4fda-b466-48e4cd9a2346): created successfully Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfb9c08-70e7-4886-a93c-41c463280c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (5c65e3fa-e2ef-43ce-86ef-86dbef5892b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3db150b9-eabd-409f-b8eb-37a420e52b2a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created volume successfully. Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (71fa0bd2-f3ea-4413-a262-7d9f16f17c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19912a8e-14df-4e5f-bea1-91328cf65e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Acquiring lock "cinder-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19912a8e-14df-4e5f-bea1-91328cf65e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450430021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b80f14-a807-48fe-a9c9-934179f11c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:07Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d762be-9808-40f2-b16c-2db725ce8250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d762be-9808-40f2-b16c-2db725ce8250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5b9e7e-6766-443e-9cd9-7cf659710f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5b9e7e-6766-443e-9cd9-7cf659710f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9b80f14-a807-48fe-a9c9-934179f11c3e', 'volume_name': 'volume-b9b80f14-a807-48fe-a9c9-934179f11c3e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7659b9e-60f7-4b07-965e-4e9163efa71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7659b9e-60f7-4b07-965e-4e9163efa71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7036130d-fdfa-414b-a97d-aaa2248b423c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:07 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume b9b80f14-a807-48fe-a9c9-934179f11c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9b80f14-a807-48fe-a9c9-934179f11c3e', 'volume_size': 1} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "cinder-38b2c88c-782d-49ed-9bef-bfeab88eceb5-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-38b2c88c-782d-49ed-9bef-bfeab88eceb5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Acquiring lock "cinder-quobyte-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-quobyte-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "cinder-quobyte-38b2c88c-782d-49ed-9bef-bfeab88eceb5" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eca7251-3570-4ad0-8820-9d500406f0b1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-quobyte-38b2c88c-782d-49ed-9bef-bfeab88eceb5" acquired by "delete_volume" :: waited 0.029s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f185736-204e-41fb-b9a5-b22cc6c11e76]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:07 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910 Jul 23 10:38:07 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:07 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5 Jul 23 10:38:07 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:07 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2 1073741824" returned: 0 in 0.524s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:07 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2 Jul 23 10:38:07 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:07 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910" returned: 0 in 0.380s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:07 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910 Jul 23 10:38:07 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:07 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5" returned: 0 in 0.416s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:07 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2" returned: 0 in 0.274s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:07 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5 Jul 23 10:38:07 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.839s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] Creating offline snapshot 12911207-bfa7-497a-9e41-44e79e2a3d48 of volume 2031d4ad-d087-4969-932d-6d9f7092a6e2 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e71454-74c5-4bb5-863b-e3a2cda8b25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf95d436-81a2-4ea1-bd65-389b27c329d2', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21c88cf-fec8-498b-adb8-6da107cfaa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f449bc-a8a2-40ee-8f03-d8b0ff9b946c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:07 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume volume-bf95d436-81a2-4ea1-bd65-389b27c329d2 (bf95d436-81a2-4ea1-bd65-389b27c329d2): created successfully Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21c88cf-fec8-498b-adb8-6da107cfaa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (bc9ec74f-b978-43aa-81cd-2a68ea69b9a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-60b14be5-37c7-4d7f-9ea2-cc3b76bb34e2 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created volume successfully. Jul 23 10:38:08 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 Jul 23 10:38:08 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:08 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910" returned: 0 in 0.280s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-quobyte-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910" released by "delete_volume" :: held 0.707s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:08 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-38b2c88c-782d-49ed-9bef-bfeab88eceb5" returned: 0 in 0.281s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Created reservations ['5435297d-59c6-4ef3-a103-73b73ec56cc1', '376c6889-5c1f-411e-9d3f-d227c0baa645', '6c65476d-b6fb-407c-b1ab-1938c6e107a3', '4d46f6b6-73c1-4b7d-92d7-593e3f8e2aac'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-quobyte-38b2c88c-782d-49ed-9bef-bfeab88eceb5" released by "delete_volume" :: held 0.750s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:08 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:08 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Created reservations ['be1bc479-a234-40af-af49-3a18c1a7d40e', '1b5e44e7-b4f2-4a02-8a2c-aba6cd34b59b', 'f3696fd0-9c44-4897-bab5-59b7e34c090c', '94b56cfc-48d4-46a0-9be4-3068e6f9e48f'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:08 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2" returned: 0 in 0.451s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:08 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 1G Jul 23 10:38:08 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:08 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:08 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "cinder-66dd3a81-a04b-458d-8ea1-649114a498bd-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-66dd3a81-a04b-458d-8ea1-649114a498bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "cinder-quobyte-66dd3a81-a04b-458d-8ea1-649114a498bd" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-quobyte-66dd3a81-a04b-458d-8ea1-649114a498bd" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f187802e-1dd8-44e9-b097-12315117e8e4]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:08 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.423s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:08 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Deleted volume successfully. Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-71881744-8a57-4fa7-a615-09923a194068 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-cf6dec1d-7427-4b3a-bcc5-03b7dcec4910-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:08 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd Jul 23 10:38:08 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:08 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.497s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:08 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Deleted volume successfully. Jul 23 10:38:08 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-05e0a4c7-168a-4af7-b021-912cab3c64fa tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-38b2c88c-782d-49ed-9bef-bfeab88eceb5-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Flow 'volume_create_manager' (d2d03846-f4c8-4d1f-9d36-154e1203e26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:09 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77db04c-3ead-4de2-8e97-14268f4048f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 1G" returned: 0 in 0.688s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77db04c-3ead-4de2-8e97-14268f4048f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490954259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdef0c10-9d5c-4b4b-8f35-3583542e0ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ee2e30f5844ab297c657f361e75ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:09Z,use_quota=True,user_id='75e1032617dd4f269ec63b62ecb33aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:09 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 Jul 23 10:38:09 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad9773c-8e8b-441c-bae1-978ab6e67469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad9773c-8e8b-441c-bae1-978ab6e67469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284990d6-1bae-4085-9c46-6345ebe2657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284990d6-1bae-4085-9c46-6345ebe2657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdef0c10-9d5c-4b4b-8f35-3583542e0ccd', 'volume_name': 'volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a9b84a-82e5-4d47-81aa-36ae907ca946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a9b84a-82e5-4d47-81aa-36ae907ca946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39883afe-867c-4c58-abbd-089e1e39debb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:09 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Volume fdef0c10-9d5c-4b4b-8f35-3583542e0ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd', 'volume_size': 1} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:09 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd" returned: 0 in 0.520s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:09 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd Jul 23 10:38:09 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:09 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48" returned: 0 in 0.298s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:09 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 is being set with open permissions: ugo+rw Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:09 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 Jul 23 10:38:09 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:09 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-66dd3a81-a04b-458d-8ea1-649114a498bd" returned: 0 in 0.260s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-quobyte-66dd3a81-a04b-458d-8ea1-649114a498bd" released by "delete_volume" :: held 0.834s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Created reservations ['2981a4f3-1e50-4a1a-b414-e0763f6f2ca1', 'c18a34d1-65e4-41c4-97ff-f9a160ba3c8c', '71c86a65-257d-4e22-b9ba-01a72e574090', '3a5dc9af-15e2-4e67-87d2-276ebfe1dc24'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:09 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:09 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:09 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:09 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.info Jul 23 10:38:09 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:09 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.247s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:09 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Deleted volume successfully. Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-d160659b-c1e3-4890-a4e1-4791fe15708a tempest-CreateVolumesFromImageTest-1909693080 None] Lock "cinder-66dd3a81-a04b-458d-8ea1-649114a498bd-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:09 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.info" returned: 0 in 0.282s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:09 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.info is being set with open permissions: ugo+rw Jul 23 10:38:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:09 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.info Jul 23 10:38:09 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:10 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.info" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.724s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1339400304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a576b3ca-a57b-48f5-be6c-075c49b94a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:06Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Creating volume a576b3ca-a57b-48f5-be6c-075c49b94a08 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:10 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:10 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08 1073741824 Jul 23 10:38:10 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:10 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-22b6a3e3-de31-44b1-a59e-bdbe4fb85338 tempest-ProjectReaderTests-1355507435 None] Create snapshot completed successfully Jul 23 10:38:10 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08 1073741824" returned: 0 in 0.458s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:10 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08 Jul 23 10:38:10 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:10 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08" returned: 0 in 0.260s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.079s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570549228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96dbd28-3e5b-4dfc-8366-7bcbc403ac70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:07Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Creating volume b96dbd28-3e5b-4dfc-8366-7bcbc403ac70 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:11 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e291e6bd-50ab-4fc2-b5b4-812a084f8c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a576b3ca-a57b-48f5-be6c-075c49b94a08', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f745af-e81f-4aaf-bd4b-e3053a33502f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:11 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70 1073741824 Jul 23 10:38:11 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:11 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume volume-a576b3ca-a57b-48f5-be6c-075c49b94a08 (a576b3ca-a57b-48f5-be6c-075c49b94a08): created successfully Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f745af-e81f-4aaf-bd4b-e3053a33502f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (b5e47f79-3806-4000-afea-cc82cc225bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:11 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-358d1d19-e80d-4a08-bbf7-269718c1ea69 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created volume successfully. Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-12911207-bfa7-497a-9e41-44e79e2a3d48-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-12911207-bfa7-497a-9e41-44e79e2a3d48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-2031d4ad-d087-4969-932d-6d9f7092a6e2" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-2031d4ad-d087-4969-932d-6d9f7092a6e2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-12911207-bfa7-497a-9e41-44e79e2a3d48" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-12911207-bfa7-497a-9e41-44e79e2a3d48" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Deleting offline snapshot 12911207-bfa7-497a-9e41-44e79e2a3d48 of volume 2031d4ad-d087-4969-932d-6d9f7092a6e2 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] snapshot_file for this snap is: volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f733feec-a90f-4c1c-9777-98d9aa48c14b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:11 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70 1073741824" returned: 0 in 0.554s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:11 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 Jul 23 10:38:11 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:11 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70 Jul 23 10:38:11 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:11 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48" returned: 0 in 0.393s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2031d4ad-d087-4969-932d-6d9f7092a6e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:38:11 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a016d8e-a39b-4ec8-bc69-135a0aeac9b4]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70" returned: 0 in 0.298s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.606s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450430021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b80f14-a807-48fe-a9c9-934179f11c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d403f19eae5f4154994db4399a3d5433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:07Z,use_quota=True,user_id='2d4f61ea517c42eabf5ba8097e7dd1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Creating volume b9b80f14-a807-48fe-a9c9-934179f11c3e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:11 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2b6b45-a72d-4551-8533-b5a951f09657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:11 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e 1073741824 Jul 23 10:38:11 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9547cd60-53a1-45dd-8d5a-f847e802c4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:11 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70 (b96dbd28-3e5b-4dfc-8366-7bcbc403ac70): created successfully Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9547cd60-53a1-45dd-8d5a-f847e802c4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (2087fd14-6c34-452a-8ae7-0a28c86f2519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:12 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-16a961cd-daa8-47fa-8597-a7dbdb55b9c4 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created volume successfully. Jul 23 10:38:12 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 Jul 23 10:38:12 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:12 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2" returned: 0 in 0.390s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:12 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 Jul 23 10:38:12 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:12 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e 1073741824" returned: 0 in 0.463s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:12 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e Jul 23 10:38:12 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:12 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48" returned: 0 in 0.356s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:12 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48 Jul 23 10:38:12 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:12 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e" returned: 0 in 0.318s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.614s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490954259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdef0c10-9d5c-4b4b-8f35-3583542e0ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ee2e30f5844ab297c657f361e75ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:09Z,use_quota=True,user_id='75e1032617dd4f269ec63b62ecb33aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Creating volume fdef0c10-9d5c-4b4b-8f35-3583542e0ccd {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:12 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:12 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd 1073741824 Jul 23 10:38:12 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7036130d-fdfa-414b-a97d-aaa2248b423c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b80f14-a807-48fe-a9c9-934179f11c3e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f7213b-d1dd-4098-929a-f469abd01d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:12 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Volume volume-b9b80f14-a807-48fe-a9c9-934179f11c3e (b9b80f14-a807-48fe-a9c9-934179f11c3e): created successfully Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f7213b-d1dd-4098-929a-f469abd01d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Flow 'volume_create_manager' (71fa0bd2-f3ea-4413-a262-7d9f16f17c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:12 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8f7850fe-a464-4ca7-be30-99d05e0eb74f tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created volume successfully. Jul 23 10:38:12 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2.12911207-bfa7-497a-9e41-44e79e2a3d48" returned: 0 in 0.285s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-12911207-bfa7-497a-9e41-44e79e2a3d48" released by "_delete_snapshot" :: held 1.538s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-2031d4ad-d087-4969-932d-6d9f7092a6e2" released by "delete_snapshot" :: held 1.563s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Created reservations ['f4ed3f3b-67e1-459b-8b1c-958185dc1f53', 'd03c21ca-3104-4756-a172-30a5908586e4', '2be22f9b-ed9c-4d1c-95ca-2e78edcfc009', 'd3a55cca-685b-4b62-ace9-fcadb17d931b'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:13 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Delete snapshot completed successfully. Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0921eb82-7803-4fbb-83a1-bd9a0c06b211 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-12911207-bfa7-497a-9e41-44e79e2a3d48-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:13 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd 1073741824" returned: 0 in 0.526s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:13 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd Jul 23 10:38:13 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-2031d4ad-d087-4969-932d-6d9f7092a6e2-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-2031d4ad-d087-4969-932d-6d9f7092a6e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:13 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-2031d4ad-d087-4969-932d-6d9f7092a6e2" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd" returned: 0 in 0.295s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-2031d4ad-d087-4969-932d-6d9f7092a6e2" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39883afe-867c-4c58-abbd-089e1e39debb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281e3ba2-a3b7-4920-969e-2cc7a13a1e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb928550-8b35-4470-91d4-f68c61bac1de]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:13 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Volume volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd (fdef0c10-9d5c-4b4b-8f35-3583542e0ccd): created successfully Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281e3ba2-a3b7-4920-969e-2cc7a13a1e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Flow 'volume_create_manager' (d2d03846-f4c8-4d1f-9d36-154e1203e26e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:13 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-44831a30-894b-4e85-bca4-74edab96920d tempest-ProjectReaderTests-1170334319 None] Created volume successfully. Jul 23 10:38:13 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 Jul 23 10:38:13 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-b9b80f14-a807-48fe-a9c9-934179f11c3e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-b9b80f14-a807-48fe-a9c9-934179f11c3e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-quobyte-b9b80f14-a807-48fe-a9c9-934179f11c3e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-b9b80f14-a807-48fe-a9c9-934179f11c3e" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d732df-090e-4066-871f-a85d5aa01174]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:14 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e Jul 23 10:38:14 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:14 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2" returned: 0 in 0.469s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:14 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2 Jul 23 10:38:14 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:14 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2031d4ad-d087-4969-932d-6d9f7092a6e2" returned: 0 in 0.263s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:14 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Acquiring lock "cinder-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e" returned: 0 in 0.429s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-2031d4ad-d087-4969-932d-6d9f7092a6e2" released by "delete_volume" :: held 0.847s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:14 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e Jul 23 10:38:14 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Lock "cinder-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Acquiring lock "cinder-quobyte-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Lock "cinder-quobyte-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Created reservations ['56689d78-4bb9-4d9e-ae32-6a790b8603b5', 'c4996cb9-f655-4f54-a970-d143004aa70a', 'd02fbd70-e41e-4844-9a1e-7645d3139f40', 'fc839e23-11fd-4733-85df-dbf618419b7a'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e47285-7a08-4432-9cb6-5fde5db5999a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:14 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:14 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:14 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd Jul 23 10:38:14 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:14 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b9b80f14-a807-48fe-a9c9-934179f11c3e" returned: 0 in 0.382s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-b9b80f14-a807-48fe-a9c9-934179f11c3e" released by "delete_volume" :: held 0.875s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:14 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created reservations ['0f3b2b05-6beb-41b0-95f1-b7fb8c5a148f', '11ee39d5-5826-4ead-bff5-cc24a2f8d35b', '3b3cabc8-999f-4b7f-8504-c47bc3aeb519', '5ce8e15c-b54d-4d5b-a70e-a675bb56dfc5'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:15 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.335s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Deleted volume successfully. Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-fdec1948-00e6-4f5c-a323-f65d2bfe0a47 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-2031d4ad-d087-4969-932d-6d9f7092a6e2-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:15 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:15 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:15 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd" returned: 0 in 0.539s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:15 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd Jul 23 10:38:15 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:15 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.268s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Deleted volume successfully. Jul 23 10:38:15 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-83d24542-c12d-4e5e-b3d3-783ce690b094 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-b9b80f14-a807-48fe-a9c9-934179f11c3e-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd" returned: 0 in 0.270s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Lock "cinder-quobyte-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd" released by "delete_volume" :: held 0.866s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Created reservations ['e1fc69a4-d49c-413d-92b5-1e636a294d86', 'cf338013-3a14-48e5-8f66-a220101932e2', '5580e34e-ab0c-4c14-9067-d2616ee76437', '70c0c661-5334-4024-a5d5-eb83b7ccf3e8'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:15 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:15 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Flow 'volume_create_manager' (cd873b56-de12-44fa-aeb5-9b76e2ab8a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8e607d-ebc1-46b8-85b0-d14ca635018f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8e607d-ebc1-46b8-85b0-d14ca635018f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67dcaeef-a87e-45e4-aed7-5bf489f472a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30be5e15ead42a6b26c50f91b40d875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:16Z,use_quota=True,user_id='034f34fa54c444e9b71d6af9b0e81454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb6f772-4bb3-439a-b12a-8ae75f05daf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb6f772-4bb3-439a-b12a-8ae75f05daf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfcb17f-42d7-4d00-b1ad-a9fa91a5bb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.image.glance [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Creating Keystone auth plugin from conf {{(pid=88371) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 10:38:15 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.275s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:15 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Deleted volume successfully. Jul 23 10:38:15 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-048fbd2b-e54c-4126-ab35-4b252bbbb1bb tempest-ProjectReaderTests-1170334319 None] Lock "cinder-fdef0c10-9d5c-4b4b-8f35-3583542e0ccd-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfcb17f-42d7-4d00-b1ad-a9fa91a5bb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '67dcaeef-a87e-45e4-aed7-5bf489f472a2', 'volume_name': 'volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2', 'volume_size': 1, 'image_id': 'be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '077d2485bf12d16563310a4d55663969', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd30be5e15ead42a6b26c50f91b40d875', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35a23f6e60401f5a35798076c46ce983612eaf2b5a7224b377d8f74803e45f6f165de827310539fdcdcb65898e7b4d06384611d2edd3cde4f21ed8cd56ad1631', 'id': 'be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'created_at': datetime.datetime(2026, 7, 23, 8, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be33d26b-8cb0-4dd0-94a7-3be1b3007c70/file', 'properties': {}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14cccee-25db-460a-97f8-2fa827ae618d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14cccee-25db-460a-97f8-2fa827ae618d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa51bb2-9f52-401c-9a5f-5aad421fc711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Volume 67dcaeef-a87e-45e4-aed7-5bf489f472a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2', 'volume_size': 1, 'image_id': 'be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '077d2485bf12d16563310a4d55663969', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd30be5e15ead42a6b26c50f91b40d875', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35a23f6e60401f5a35798076c46ce983612eaf2b5a7224b377d8f74803e45f6f165de827310539fdcdcb65898e7b4d06384611d2edd3cde4f21ed8cd56ad1631', 'id': 'be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'created_at': datetime.datetime(2026, 7, 23, 8, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be33d26b-8cb0-4dd0-94a7-3be1b3007c70/file', 'properties': {}}, 'image_service': } Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Trying to clone 67dcaeef-a87e-45e4-aed7-5bf489f472a2 from image be33d26b-8cb0-4dd0-94a7-3be1b3007c70 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'metadata': {}}]). {{(pid=88371) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 10:38:16 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Image download 0.00 MB at 0.00 MB/s Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Flow 'volume_create_manager' (335d36bc-94c9-428d-88f9-b303078471cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc32a59b-6a6f-4f0e-b3b2-953c28d687c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc32a59b-6a6f-4f0e-b3b2-953c28d687c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-990838688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84534f73-10b5-4776-8d9b-fe45b4176a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ee2e30f5844ab297c657f361e75ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:16Z,use_quota=True,user_id='75e1032617dd4f269ec63b62ecb33aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6daf01-3552-4cf6-a619-0825b0b11442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6daf01-3552-4cf6-a619-0825b0b11442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14729309-a524-45ef-a0ab-68f8e876fa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14729309-a524-45ef-a0ab-68f8e876fa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84534f73-10b5-4776-8d9b-fe45b4176a50', 'volume_name': 'volume-84534f73-10b5-4776-8d9b-fe45b4176a50', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23794ec1-cc98-484b-a016-50c8a18e4098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23794ec1-cc98-484b-a016-50c8a18e4098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc3dfec-ca9c-49ed-ad7f-5084ea1892ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Volume 84534f73-10b5-4776-8d9b-fe45b4176a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84534f73-10b5-4776-8d9b-fe45b4176a50', 'volume_size': 1} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-990838688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84534f73-10b5-4776-8d9b-fe45b4176a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ee2e30f5844ab297c657f361e75ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:16Z,use_quota=True,user_id='75e1032617dd4f269ec63b62ecb33aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Creating volume 84534f73-10b5-4776-8d9b-fe45b4176a50 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:16 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dca72a-13eb-4a46-957c-0c9c97d1dcad]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:16 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50 1073741824 Jul 23 10:38:16 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-quobyte-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[0156ec97-8cf0-4ef4-b7f4-d0820efa41bf]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:16 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD Jul 23 10:38:16 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Flow 'volume_create_manager' (68937fb9-874f-484a-888f-edbd5b9e0e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffec6ed-a7bc-43ff-8ef0-a86e6bcb0014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffec6ed-a7bc-43ff-8ef0-a86e6bcb0014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144835890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64fb9d1-01aa-4166-acca-bd85371baf88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56c49beec4747b2ac72c5c63b043d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:16Z,use_quota=True,user_id='d8305d36fd2d44898be4a4a1bcdca485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52486e9-17ec-4e81-a152-07314e345566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52486e9-17ec-4e81-a152-07314e345566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626fd70e-156b-4482-99b3-cdf4a24c997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626fd70e-156b-4482-99b3-cdf4a24c997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64fb9d1-01aa-4166-acca-bd85371baf88', 'volume_name': 'volume-d64fb9d1-01aa-4166-acca-bd85371baf88', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd683e04-6625-45d3-b6fe-3250d93536b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd683e04-6625-45d3-b6fe-3250d93536b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:16 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70 Jul 23 10:38:16 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ad9956-958a-415d-a0e4-258c23f0e91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:16 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Volume d64fb9d1-01aa-4166-acca-bd85371baf88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64fb9d1-01aa-4166-acca-bd85371baf88', 'volume_size': 1} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:16 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:16 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50 1073741824" returned: 0 in 0.466s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:16 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50 Jul 23 10:38:16 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:16 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70" returned: 0 in 0.429s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:16 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD Jul 23 10:38:16 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:16 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70 Jul 23 10:38:16 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:17 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50" returned: 0 in 0.266s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144835890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64fb9d1-01aa-4166-acca-bd85371baf88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56c49beec4747b2ac72c5c63b043d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:16Z,use_quota=True,user_id='d8305d36fd2d44898be4a4a1bcdca485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Creating volume d64fb9d1-01aa-4166-acca-bd85371baf88 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:17 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:17 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Temporary image be33d26b-8cb0-4dd0-94a7-3be1b3007c70 is fetched for user 034f34fa54c444e9b71d6af9b0e81454. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 10:38:17 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:17 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 1073741824 Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc3dfec-ca9c-49ed-ad7f-5084ea1892ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84534f73-10b5-4776-8d9b-fe45b4176a50', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:17 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1f772d-a4c1-454a-8f76-825c4e741c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70" returned: 0 in 0.286s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70" released by "delete_volume" :: held 0.764s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:17 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Volume volume-84534f73-10b5-4776-8d9b-fe45b4176a50 (84534f73-10b5-4776-8d9b-fe45b4176a50): created successfully Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1f772d-a4c1-454a-8f76-825c4e741c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Flow 'volume_create_manager' (335d36bc-94c9-428d-88f9-b303078471cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-54c0054f-565f-410e-bfbc-237ee2e1d45d tempest-ProjectReaderTests-1170334319 None] Created volume successfully. Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e90dca0-a36f-4577-a1a1-ac57d8af6166]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created reservations ['31a246ed-863b-49e3-a173-06b3d37a32b1', '33dd3735-9820-45c6-95f9-ede0321becd9', '06f67074-26c2-436e-8933-62e4bcd1a850', 'bd07cf0a-19ca-4c29-95b1-83c0b2ac1784'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:17 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:17 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:17 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD Jul 23 10:38:17 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-a576b3ca-a57b-48f5-be6c-075c49b94a08-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-a576b3ca-a57b-48f5-be6c-075c49b94a08-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-quobyte-a576b3ca-a57b-48f5-be6c-075c49b94a08" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-a576b3ca-a57b-48f5-be6c-075c49b94a08" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808f6dc-ee81-46a1-9dfd-1a0ad619f1e3]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:17 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:17 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.327s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Deleted volume successfully. Jul 23 10:38:17 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 1073741824" returned: 0 in 0.594s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:17 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08 Jul 23 10:38:17 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-1f638c69-b7f1-40d4-8fea-b91e6e20f42e tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-b96dbd28-3e5b-4dfc-8366-7bcbc403ac70-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:17 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 Jul 23 10:38:17 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:17 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD Jul 23 10:38:17 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:17 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08" returned: 0 in 0.388s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:17 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08 Jul 23 10:38:17 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:17 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:17 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88" returned: 0 in 0.252s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67dcaeef-a87e-45e4-aed7-5bf489f472a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30be5e15ead42a6b26c50f91b40d875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:16Z,use_quota=True,user_id='034f34fa54c444e9b71d6af9b0e81454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:17 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Creating volume 67dcaeef-a87e-45e4-aed7-5bf489f472a2 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:18 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ad9956-958a-415d-a0e4-258c23f0e91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64fb9d1-01aa-4166-acca-bd85371baf88', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:18 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 1073741824 Jul 23 10:38:18 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1886cc5f-e72b-42f4-8439-c2dbaad93921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:18 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Volume volume-d64fb9d1-01aa-4166-acca-bd85371baf88 (d64fb9d1-01aa-4166-acca-bd85371baf88): created successfully Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1886cc5f-e72b-42f4-8439-c2dbaad93921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Flow 'volume_create_manager' (68937fb9-874f-484a-888f-edbd5b9e0e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:18 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-2bd87c50-6221-4c80-915d-e6b6b9f2880f tempest-ProjectReaderTests-1355507435 None] Created volume successfully. Jul 23 10:38:18 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a576b3ca-a57b-48f5-be6c-075c49b94a08" returned: 0 in 0.245s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-a576b3ca-a57b-48f5-be6c-075c49b94a08" released by "delete_volume" :: held 0.679s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Acquiring lock "cinder-84534f73-10b5-4776-8d9b-fe45b4176a50-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-84534f73-10b5-4776-8d9b-fe45b4176a50-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created reservations ['6add15f3-d24e-493a-95fa-2e79a7e616b4', 'c67f7e43-ef0c-4f96-9dcd-e505011c64c1', '8bb7d767-1975-4d57-a576-d63b5356813b', '41d9775d-1f94-4d2d-b15c-dbf69ab07da9'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Acquiring lock "cinder-quobyte-84534f73-10b5-4776-8d9b-fe45b4176a50" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-quobyte-84534f73-10b5-4776-8d9b-fe45b4176a50" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e74a8f-1953-4eba-bab4-6d997cacdd4a]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:18 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:18 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:18 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50 Jul 23 10:38:18 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:18 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 1073741824" returned: 0 in 0.522s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:18 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 Jul 23 10:38:18 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:18 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.269s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:18 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Deleted volume successfully. Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-bf95d436-81a2-4ea1-bd65-389b27c329d2-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-70e46e8b-f384-4fd0-87aa-345de8a8f67a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-a576b3ca-a57b-48f5-be6c-075c49b94a08-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-bf95d436-81a2-4ea1-bd65-389b27c329d2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-quobyte-bf95d436-81a2-4ea1-bd65-389b27c329d2" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-bf95d436-81a2-4ea1-bd65-389b27c329d2" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bc9fb4-1a65-40e8-b1dd-87de7992f861]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:18 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50" returned: 0 in 0.527s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:18 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50 Jul 23 10:38:18 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:18 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2" returned: 0 in 0.376s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.145s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] Creating offline snapshot 30de5c4f-cd38-4a58-9378-35d1f1de6268 of volume d64fb9d1-01aa-4166-acca-bd85371baf88 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:38:19 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2 Jul 23 10:38:19 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Attempting download of be33d26b-8cb0-4dd0-94a7-3be1b3007c70 ((None, [{'url': 'file:///opt/stack/data/glance/images/be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'metadata': {}}])) to volume 67dcaeef-a87e-45e4-aed7-5bf489f472a2. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de64e9e-946f-4b33-a0fd-11f9854d28e0]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1bd94a-207b-4ff5-b172-c25fe0f29419]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_o0dfxmrz {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:19 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 Jul 23 10:38:19 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:19 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-84534f73-10b5-4776-8d9b-fe45b4176a50" returned: 0 in 0.255s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-quobyte-84534f73-10b5-4776-8d9b-fe45b4176a50" released by "delete_volume" :: held 0.828s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:19 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_o0dfxmrz Jul 23 10:38:19 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Created reservations ['7b088e85-ec6b-4949-be60-765bcb0480a4', 'de9bdf1d-4796-45a7-adc6-54a0cff0829a', '15e12104-3d77-4e1e-8e53-b5d9d6d11ff8', 'f1aa61d8-5b85-43f4-80ba-18c789d1667e'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:19 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2" returned: 0 in 0.446s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:19 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:19 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:19 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2 Jul 23 10:38:19 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:19 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88" returned: 0 in 0.446s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:19 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_o0dfxmrz" returned: 0 in 0.435s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_o0dfxmrz {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:19 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 1G Jul 23 10:38:19 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:19 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_o0dfxmrz Jul 23 10:38:19 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:19 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:19 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.367s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-bf95d436-81a2-4ea1-bd65-389b27c329d2" returned: 0 in 0.350s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:19 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Deleted volume successfully. Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-bf95d436-81a2-4ea1-bd65-389b27c329d2" released by "delete_volume" :: held 0.863s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bd192fef-8705-4e13-b4fe-80a2cb8a2932 tempest-ProjectReaderTests-1170334319 None] Lock "cinder-84534f73-10b5-4776-8d9b-fe45b4176a50-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created reservations ['f5ae24bf-eb56-400e-94c8-24cbd30aa08e', 'bec8935a-84e0-47d9-9302-48aff73fbc67', '3599ad46-5885-4f9d-9a93-fef94855f5c1', '90aa38fa-9f1c-497d-8188-a2d8b0cf7af0'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:19 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_o0dfxmrz" returned: 1 in 0.446s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_o0dfxmrz' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2795f98-fdab-4220-afa5-e089a883ae1f]: (4, 'raw') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:19 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:19 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:20 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 1G" returned: 0 in 0.643s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64fb9d1-01aa-4166-acca-bd85371baf88 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:20 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD Jul 23 10:38:20 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:20 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64fb9d1-01aa-4166-acca-bd85371baf88 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 Jul 23 10:38:20 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:20 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.406s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:20 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Deleted volume successfully. Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:20 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-db03300f-b38c-41bd-b133-e9a3577e570a tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-bf95d436-81a2-4ea1-bd65-389b27c329d2-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-quobyte-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc2530d-c281-4a35-aee1-3b9c17c6c75b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:20 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD Jul 23 10:38:20 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:20 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64fb9d1-01aa-4166-acca-bd85371baf88 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268" returned: 0 in 0.572s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:20 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346 Jul 23 10:38:20 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 is being set with open permissions: ugo+rw Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:20 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:20 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 Jul 23 10:38:20 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:20 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD" returned: 1 in 0.476s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] be33d26b-8cb0-4dd0-94a7-3be1b3007c70 was raw, converting to qcow2 {{(pid=88371) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 10:38:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:20 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 Jul 23 10:38:20 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:21 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268" returned: 0 in 0.403s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:21 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346" returned: 0 in 0.600s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:21 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346 Jul 23 10:38:21 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:21 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.info Jul 23 10:38:21 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:21 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346" returned: 0 in 0.345s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:21 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2" returned: 0 in 0.602s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be33d26b-8cb0-4dd0-94a7-3be1b3007c70_3ezvv5lmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:38:21 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346" released by "delete_volume" :: held 1.023s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:21 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.info" returned: 0 in 0.359s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:21 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.info is being set with open permissions: ugo+rw Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:21 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 1G Jul 23 10:38:21 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:21 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.info Jul 23 10:38:21 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created reservations ['b1a7b66f-8887-46c2-a044-e89fd9c695dd', 'e2001f58-51bb-406c-95a9-6412c6855e36', '30c6958e-c395-41f5-91d3-54798a607358', '1d17b0d2-1138-4b34-97b5-8f0de41f79a6'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:21 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:21 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:21 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.info" returned: 0 in 0.317s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:21 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 1G" returned: 0 in 0.402s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Downloaded image be33d26b-8cb0-4dd0-94a7-3be1b3007c70 ((None, [{'url': 'file:///opt/stack/data/glance/images/be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'metadata': {}}])) to volume 67dcaeef-a87e-45e4-aed7-5bf489f472a2 successfully. {{(pid=88371) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Temporary image be33d26b-8cb0-4dd0-94a7-3be1b3007c70 for user 034f34fa54c444e9b71d6af9b0e81454 is deleted. {{(pid=88371) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG cinder.volume.volume_utils [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Marking volume 67dcaeef-a87e-45e4-aed7-5bf489f472a2 as bootable. {{(pid=88371) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Copying metadata from image be33d26b-8cb0-4dd0-94a7-3be1b3007c70 to 67dcaeef-a87e-45e4-aed7-5bf489f472a2. {{(pid=88371) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Creating volume glance metadata for volume 67dcaeef-a87e-45e4-aed7-5bf489f472a2 backed by image be33d26b-8cb0-4dd0-94a7-3be1b3007c70 with: {'image_id': 'be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '077d2485bf12d16563310a4d55663969', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88371) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 10:38:21 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b6b7c865-1ef4-4832-82e3-36a24fab5333 tempest-ProjectReaderTests-1355507435 None] Create snapshot completed successfully Jul 23 10:38:21 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.288s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:21 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:21 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Deleted volume successfully. Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa51bb2-9f52-401c-9a5f-5aad421fc711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2', 'volume_size': 1, 'image_id': 'be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '077d2485bf12d16563310a4d55663969', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd30be5e15ead42a6b26c50f91b40d875', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35a23f6e60401f5a35798076c46ce983612eaf2b5a7224b377d8f74803e45f6f165de827310539fdcdcb65898e7b4d06384611d2edd3cde4f21ed8cd56ad1631', 'id': 'be33d26b-8cb0-4dd0-94a7-3be1b3007c70', 'created_at': datetime.datetime(2026, 7, 23, 8, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 8, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be33d26b-8cb0-4dd0-94a7-3be1b3007c70/file', 'properties': {}}, 'image_service': }' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64259c2-5ae2-4e01-8b31-276ee1957fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ebfc30b1-0afe-4c1a-9522-eae4e649e2e9 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-b1ec3f0c-72ed-4fda-b466-48e4cd9a2346-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:22 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Volume volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 (67dcaeef-a87e-45e4-aed7-5bf489f472a2): created successfully Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64259c2-5ae2-4e01-8b31-276ee1957fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Flow 'volume_create_manager' (cd873b56-de12-44fa-aeb5-9b76e2ab8a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:22 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c31655a3-cabc-4b81-a444-91be1b94bc8c tempest-VolumeImageDependencyTests-621103084 None] Created volume successfully. Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-30de5c4f-cd38-4a58-9378-35d1f1de6268-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-30de5c4f-cd38-4a58-9378-35d1f1de6268-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-d64fb9d1-01aa-4166-acca-bd85371baf88" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-d64fb9d1-01aa-4166-acca-bd85371baf88" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-30de5c4f-cd38-4a58-9378-35d1f1de6268" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-30de5c4f-cd38-4a58-9378-35d1f1de6268" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Deleting offline snapshot 30de5c4f-cd38-4a58-9378-35d1f1de6268 of volume d64fb9d1-01aa-4166-acca-bd85371baf88 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] snapshot_file for this snap is: volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd8f6c3-85c7-41dd-94cf-1d03e32d6d39]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:22 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 Jul 23 10:38:22 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268" returned: 0 in 0.393s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d64fb9d1-01aa-4166-acca-bd85371baf88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a3f1ec-2c4a-4aae-88f9-5b30ab6653f6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:22 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-e4ad7da0-81d4-4075-a20a-5b4a6f257f23-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-e4ad7da0-81d4-4075-a20a-5b4a6f257f23-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "cinder-quobyte-e4ad7da0-81d4-4075-a20a-5b4a6f257f23" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:22 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-e4ad7da0-81d4-4075-a20a-5b4a6f257f23" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:22 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3cb99a-6bbf-4f32-bc12-e27e46492a0e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:22 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23 Jul 23 10:38:22 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:23 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:23 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 Jul 23 10:38:23 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:23 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23" returned: 0 in 0.373s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:23 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23 Jul 23 10:38:23 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Acquiring lock "cinder-67dcaeef-a87e-45e4-aed7-5bf489f472a2-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Lock "cinder-67dcaeef-a87e-45e4-aed7-5bf489f472a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Acquiring lock "cinder-quobyte-67dcaeef-a87e-45e4-aed7-5bf489f472a2" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:23 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268" returned: 0 in 0.401s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Lock "cinder-quobyte-67dcaeef-a87e-45e4-aed7-5bf489f472a2" acquired by "delete_volume" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:23 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268 Jul 23 10:38:23 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:23 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e4ad7da0-81d4-4075-a20a-5b4a6f257f23" returned: 0 in 0.294s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[40331e6b-54d6-42b5-aa79-66f3625d83a8]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-quobyte-e4ad7da0-81d4-4075-a20a-5b4a6f257f23" released by "delete_volume" :: held 0.722s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Created reservations ['0d115b38-1a7f-4939-b76a-de96b11a933f', 'ce45a594-19b0-4eed-9902-0cd0eff53410', '340ea95f-c31c-4d7d-a3d1-b887f580c964', '3244e93b-7541-471f-bd16-083d69991c53'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:23 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 Jul 23 10:38:23 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:23 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:23 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:23 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88.30de5c4f-cd38-4a58-9378-35d1f1de6268" returned: 0 in 0.256s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-30de5c4f-cd38-4a58-9378-35d1f1de6268" released by "_delete_snapshot" :: held 1.563s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-d64fb9d1-01aa-4166-acca-bd85371baf88" released by "delete_snapshot" :: held 1.585s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Created reservations ['13e9c9cd-5b90-4db7-ba96-0fa48245290f', '08fb4ca7-0bbc-4ab5-be09-9c70f0f9f923', '02225e91-d300-4daa-8a10-47b08493fdf3', 'd45f32c6-2d64-4225-831c-afee61ea09a9'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:23 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:23 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Delete snapshot completed successfully. Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2" returned: 0 in 0.399s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4ccd202c-aa3a-4279-a8a6-d12e54a9b852 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-30de5c4f-cd38-4a58-9378-35d1f1de6268-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:23 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.282s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:23 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Deleted volume successfully. Jul 23 10:38:23 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2 Jul 23 10:38:23 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:23 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d285fc5-6db3-4173-af64-186ad6c7e473 tempest-CreateVolumesFromSourceVolumeTest-1372112308 None] Lock "cinder-e4ad7da0-81d4-4075-a20a-5b4a6f257f23-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:24 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-67dcaeef-a87e-45e4-aed7-5bf489f472a2" returned: 0 in 0.254s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Lock "cinder-quobyte-67dcaeef-a87e-45e4-aed7-5bf489f472a2" released by "delete_volume" :: held 0.702s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Created reservations ['51175c4b-a53a-4685-b317-c961c58278a1', '43371bde-6eda-4aa3-88df-fdc63a7ecca5', 'e0a60792-1982-4a46-bd25-c1e8f93acdd8', '560d9fbd-1310-4bb6-a782-9fd6414c3ebf'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:24 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:24 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-d64fb9d1-01aa-4166-acca-bd85371baf88-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Lock "cinder-d64fb9d1-01aa-4166-acca-bd85371baf88-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-d64fb9d1-01aa-4166-acca-bd85371baf88" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-d64fb9d1-01aa-4166-acca-bd85371baf88" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b51ffa-88c8-4548-adb0-535873a155c1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:24 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.319s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:24 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Deleted volume successfully. Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-cf464c03-81aa-4935-acc7-8eb3dbc9f856 tempest-VolumeImageDependencyTests-621103084 None] Lock "cinder-67dcaeef-a87e-45e4-aed7-5bf489f472a2-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:24 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 Jul 23 10:38:24 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:24 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88" returned: 0 in 0.456s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:24 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:24 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88 Jul 23 10:38:24 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:25 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-d64fb9d1-01aa-4166-acca-bd85371baf88" returned: 0 in 0.270s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-d64fb9d1-01aa-4166-acca-bd85371baf88" released by "delete_volume" :: held 0.822s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Created reservations ['fa73b361-59fd-4507-b5ed-6225f21a3f03', '16f6a78a-6b02-4ebe-bba4-180a090f3071', '4427bd8a-3b00-4952-8b27-f336a5eff6b8', '4b79f2c3-4e99-4067-82d4-726e24343701'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:25 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:25 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:25 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.373s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:25 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Deleted volume successfully. Jul 23 10:38:25 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5feb3f98-3478-4794-b50c-b17ce689d20d tempest-ProjectReaderTests-1355507435 None] Lock "cinder-d64fb9d1-01aa-4166-acca-bd85371baf88-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Flow 'volume_create_manager' (b9967a8e-64cd-4006-9b50-534bb8b58f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7052c1-76ca-4568-bd5e-19e457edd1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7052c1-76ca-4568-bd5e-19e457edd1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575943937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18948676-0346-4198-aad8-81cde1d2642c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56c49beec4747b2ac72c5c63b043d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:26Z,use_quota=True,user_id='d8305d36fd2d44898be4a4a1bcdca485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44662b5-6c04-46c5-8ae0-974e5323880a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44662b5-6c04-46c5-8ae0-974e5323880a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce0baaa-669d-4ea4-8b46-dbf3d4c3d6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce0baaa-669d-4ea4-8b46-dbf3d4c3d6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18948676-0346-4198-aad8-81cde1d2642c', 'volume_name': 'volume-18948676-0346-4198-aad8-81cde1d2642c', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da61f7d-b5f3-4f2d-9a9d-848505d180b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da61f7d-b5f3-4f2d-9a9d-848505d180b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dfc909-c4c7-4ab8-8265-7ecfd0a60d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:26 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Volume 18948676-0346-4198-aad8-81cde1d2642c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18948676-0346-4198-aad8-81cde1d2642c', 'volume_size': 1} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575943937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18948676-0346-4198-aad8-81cde1d2642c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56c49beec4747b2ac72c5c63b043d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:26Z,use_quota=True,user_id='d8305d36fd2d44898be4a4a1bcdca485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Creating volume 18948676-0346-4198-aad8-81cde1d2642c {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:26 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:26 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c 1073741824 Jul 23 10:38:26 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:26 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c 1073741824" returned: 0 in 0.484s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:26 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c Jul 23 10:38:26 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:27 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c" returned: 0 in 0.294s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dfc909-c4c7-4ab8-8265-7ecfd0a60d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18948676-0346-4198-aad8-81cde1d2642c', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439ff77c-a5b9-477f-a8d0-4cb8bbe2b518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:27 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Volume volume-18948676-0346-4198-aad8-81cde1d2642c (18948676-0346-4198-aad8-81cde1d2642c): created successfully Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439ff77c-a5b9-477f-a8d0-4cb8bbe2b518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Flow 'volume_create_manager' (b9967a8e-64cd-4006-9b50-534bb8b58f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:27 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-62cd1232-a7d7-4602-9edc-ac86e78c94f2 tempest-ProjectReaderTests-1355507435 None] Created volume successfully. Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Flow 'volume_create_manager' (d09ad1f0-accb-408f-856b-f00b9a7a85e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9d0cfe-214e-42e4-911e-c67b82a874ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9d0cfe-214e-42e4-911e-c67b82a874ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1859122372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb825be-b5f1-4e1e-a513-452a6d6586a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c421864adbb40c2aaa7e32774b9680d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:27Z,use_quota=True,user_id='9a8c2eea33ef461990ada6a9276a60ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1bc4e63-356b-421a-9c48-2140fd0232a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1bc4e63-356b-421a-9c48-2140fd0232a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583a2600-9a18-4936-b615-b32db93f2867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583a2600-9a18-4936-b615-b32db93f2867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb825be-b5f1-4e1e-a513-452a6d6586a2', 'volume_name': 'volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f132d2ef-79cf-4668-9549-1ef332898d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f132d2ef-79cf-4668-9549-1ef332898d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84433971-7b80-436b-8ff6-d85182c12221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:27 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Volume dcb825be-b5f1-4e1e-a513-452a6d6586a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2', 'volume_size': 1} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1859122372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb825be-b5f1-4e1e-a513-452a6d6586a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c421864adbb40c2aaa7e32774b9680d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:27Z,use_quota=True,user_id='9a8c2eea33ef461990ada6a9276a60ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Creating volume dcb825be-b5f1-4e1e-a513-452a6d6586a2 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:27 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:27 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 1073741824 Jul 23 10:38:27 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:27 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 1073741824" returned: 0 in 0.449s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=246,cinder:UPDATE=334,cinder:DELETE=30,cinder:INSERT=99 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:38:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:27 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 Jul 23 10:38:27 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:28 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84433971-7b80-436b-8ff6-d85182c12221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc40186c-8e07-4609-80d0-cc7851287af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:28 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Volume volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 (dcb825be-b5f1-4e1e-a513-452a6d6586a2): created successfully Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc40186c-8e07-4609-80d0-cc7851287af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Flow 'volume_create_manager' (d09ad1f0-accb-408f-856b-f00b9a7a85e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:28 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-3daff2be-2fe7-46ae-b2f0-3edc6cc5164b tempest-VolumeDependencyTests-1626644530 None] Created volume successfully. Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=256,cinder:UPDATE=369,cinder:INSERT=87,cinder:DELETE=32 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] Creating offline snapshot 9da45659-890f-4e66-8d50-046bfec005a4 of volume 18948676-0346-4198-aad8-81cde1d2642c {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd10cdb8-a26f-49ca-bbf5-7cab479c9428]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:28 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c Jul 23 10:38:28 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:28 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:28 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 1G Jul 23 10:38:28 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:29 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 1G" returned: 0 in 0.402s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18948676-0346-4198-aad8-81cde1d2642c -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:29 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18948676-0346-4198-aad8-81cde1d2642c -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 Jul 23 10:38:29 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:29 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18948676-0346-4198-aad8-81cde1d2642c -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4" returned: 0 in 0.307s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:29 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 is being set with open permissions: ugo+rw Jul 23 10:38:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:29 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 Jul 23 10:38:29 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:29 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4" returned: 0 in 0.239s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:29 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.info Jul 23 10:38:29 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:30 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.info" returned: 0 in 0.283s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:30 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.info is being set with open permissions: ugo+rw Jul 23 10:38:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:30 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.info Jul 23 10:38:30 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:30 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.info" returned: 0 in 0.260s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.992s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.770s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:30 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] Creating offline snapshot b834a697-366d-4ad2-988e-a471c07ab2e9 of volume dcb825be-b5f1-4e1e-a513-452a6d6586a2 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:38:30 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[224dea4e-f423-4866-94fa-57e092fef53b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:30 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-796f3041-b413-4cce-bd7f-ce46eca8b4e6 tempest-ProjectReaderTests-1355507435 None] Create snapshot completed successfully Jul 23 10:38:30 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 Jul 23 10:38:30 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:30 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2" returned: 0 in 0.404s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:30 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 1G Jul 23 10:38:30 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:31 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 1G" returned: 0 in 0.451s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:31 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 Jul 23 10:38:31 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-9da45659-890f-4e66-8d50-046bfec005a4-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-9da45659-890f-4e66-8d50-046bfec005a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-18948676-0346-4198-aad8-81cde1d2642c" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-18948676-0346-4198-aad8-81cde1d2642c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-9da45659-890f-4e66-8d50-046bfec005a4" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-9da45659-890f-4e66-8d50-046bfec005a4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Deleting offline snapshot 9da45659-890f-4e66-8d50-046bfec005a4 of volume 18948676-0346-4198-aad8-81cde1d2642c {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:38:31 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] snapshot_file for this snap is: volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9" returned: 0 in 0.369s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:31 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 is being set with open permissions: ugo+rw Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[278d14fb-c355-4e0d-81c2-629d46354705]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:31 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 Jul 23 10:38:31 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:31 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 Jul 23 10:38:31 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:31 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9" returned: 0 in 0.257s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:32 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.info Jul 23 10:38:32 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:32 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4" returned: 0 in 0.380s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18948676-0346-4198-aad8-81cde1d2642c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5619c505-374e-4882-a75e-9d76d7c5077c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:32 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c Jul 23 10:38:32 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:32 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.info" returned: 0 in 0.278s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:32 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.info is being set with open permissions: ugo+rw Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:32 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.info Jul 23 10:38:32 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:32 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.info" returned: 0 in 0.255s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:32 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c" returned: 0 in 0.427s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:32 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 Jul 23 10:38:32 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:32 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0c76d8b1-3282-4f6a-9fc2-bcbae1b3d944 tempest-VolumeDependencyTests-1626644530 None] Create snapshot completed successfully Jul 23 10:38:32 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4" returned: 0 in 0.378s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:32 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4 Jul 23 10:38:32 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:33 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c.9da45659-890f-4e66-8d50-046bfec005a4" returned: 0 in 0.272s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-9da45659-890f-4e66-8d50-046bfec005a4" released by "_delete_snapshot" :: held 1.587s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-18948676-0346-4198-aad8-81cde1d2642c" released by "delete_snapshot" :: held 1.619s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Created reservations ['ee800997-04b6-4c2b-8d0f-28c5e41bc370', '3b0b7424-326b-4f55-8c32-9a74ce9e142a', '18186b8e-c950-4ad2-8ad0-9220210bd7f7', '611c6812-0f57-4a11-af8d-338bcf06dcd9'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:33 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Delete snapshot completed successfully. Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f0a0abd7-d96a-45b8-a8db-cb2e271d70f8 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-9da45659-890f-4e66-8d50-046bfec005a4-delete_snapshot" released by "delete_snapshot" :: held 1.780s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (490a0c1b-4c7c-4eeb-adb2-f73f2453cb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c719c7-2f9f-4a72-8b9c-61b8b24c1701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c719c7-2f9f-4a72-8b9c-61b8b24c1701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274767681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4fcf06-fc51-4426-a7c0-9642f03132d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:34Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422c5462-19ba-4070-a499-50eb51336d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422c5462-19ba-4070-a499-50eb51336d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6549cb60-fce4-4e16-b3c5-fe78e242aec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6549cb60-fce4-4e16-b3c5-fe78e242aec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f4fcf06-fc51-4426-a7c0-9642f03132d1', 'volume_name': 'volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bab84ae-90d0-47d5-a12b-c5f39dc81bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bab84ae-90d0-47d5-a12b-c5f39dc81bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5414f6-7ee9-4545-a624-b068c3e52812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:33 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Volume 9f4fcf06-fc51-4426-a7c0-9642f03132d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1', 'volume_size': 1} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274767681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4fcf06-fc51-4426-a7c0-9642f03132d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:34Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Creating volume 9f4fcf06-fc51-4426-a7c0-9642f03132d1 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:33 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-18948676-0346-4198-aad8-81cde1d2642c-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:33 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 1073741824 Jul 23 10:38:33 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Flow 'volume_create_manager' (30261fdf-4044-4a7d-99b3-7bd9181cd231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14426e4-3aa3-4c52-a9d2-74a85312b2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-18948676-0346-4198-aad8-81cde1d2642c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14426e4-3aa3-4c52-a9d2-74a85312b2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1882791593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101c10ee-0920-4504-9ee0-b93bfbdaae08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c421864adbb40c2aaa7e32774b9680d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b834a697-366d-4ad2-988e-a471c07ab2e9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:34Z,use_quota=True,user_id='9a8c2eea33ef461990ada6a9276a60ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048a648d-9ef4-4600-8fec-10038a7f1e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048a648d-9ef4-4600-8fec-10038a7f1e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d9fd51-0941-4258-a92c-82e679af82b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d9fd51-0941-4258-a92c-82e679af82b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '101c10ee-0920-4504-9ee0-b93bfbdaae08', 'volume_name': 'volume-101c10ee-0920-4504-9ee0-b93bfbdaae08', 'volume_size': 1, 'snapshot_id': 'b834a697-366d-4ad2-988e-a471c07ab2e9'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5be777c-9025-418f-89ad-c52a925ad81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5be777c-9025-418f-89ad-c52a925ad81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a60529-2eb1-44ad-9b67-2fcb6329e486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:33 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Volume 101c10ee-0920-4504-9ee0-b93bfbdaae08: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-101c10ee-0920-4504-9ee0-b93bfbdaae08', 'volume_size': 1, 'snapshot_id': 'b834a697-366d-4ad2-988e-a471c07ab2e9'} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-18948676-0346-4198-aad8-81cde1d2642c" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-18948676-0346-4198-aad8-81cde1d2642c" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb6f36c-bafc-425c-acd0-04dd82182114]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:33 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:34 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c Jul 23 10:38:34 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:34 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 1073741824" returned: 0 in 0.432s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:34 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 Jul 23 10:38:34 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:34 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c" returned: 0 in 0.372s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:34 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c Jul 23 10:38:34 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:34 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.595s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "cinder-quobyte-b834a697-366d-4ad2-988e-a471c07ab2e9-101c10ee-0920-4504-9ee0-b93bfbdaae08" by "_create_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5414f6-7ee9-4545-a624-b068c3e52812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8354f776-91a3-453f-8d51-96b7753ffe29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-b834a697-366d-4ad2-988e-a471c07ab2e9-101c10ee-0920-4504-9ee0-b93bfbdaae08" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Creating volume 101c10ee-0920-4504-9ee0-b93bfbdaae08 from snapshot b834a697-366d-4ad2-988e-a471c07ab2e9 {{(pid=88371) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "cinder-quobyte-101c10ee-0920-4504-9ee0-b93bfbdaae08" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:34 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Volume volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 (9f4fcf06-fc51-4426-a7c0-9642f03132d1): created successfully Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8354f776-91a3-453f-8d51-96b7753ffe29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (490a0c1b-4c7c-4eeb-adb2-f73f2453cb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-101c10ee-0920-4504-9ee0-b93bfbdaae08" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] snapshot: b834a697-366d-4ad2-988e-a471c07ab2e9, volume: 101c10ee-0920-4504-9ee0-b93bfbdaae08, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:38:34 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-abb39219-3ca9-4539-bba1-03708a0621b4 tempest-ProjectMemberTests-1385482585 None] Created volume successfully. Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:34 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-18948676-0346-4198-aad8-81cde1d2642c" returned: 0 in 0.274s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a87860-2c84-4ec4-8feb-2a6e0410d3ac]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-18948676-0346-4198-aad8-81cde1d2642c" released by "delete_volume" :: held 0.713s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Created reservations ['9cf5b61c-0b1a-4a3b-a86c-bd67b8fa3a28', 'c9cd60fd-4f73-4e00-ab38-ec6256873b3a', '53a5d413-2258-418e-8ea4-c4b294c501d7', '9390111d-c0ea-4d91-a05a-fc1c2ce33b30'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:34 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 Jul 23 10:38:34 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:34 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:34 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:34 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.249s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:34 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:34 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Deleted volume successfully. Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8287a767-0a79-4066-a171-c6e847148c32 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-18948676-0346-4198-aad8-81cde1d2642c-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:35 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9" returned: 0 in 0.428s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e6c6fa-70c9-4d22-bc45-380c1bca7d29]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:35 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 Jul 23 10:38:35 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Flow 'volume_create_manager' (1e997d23-de8b-407b-9da5-1b3233f061cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78100aa4-051a-4d46-ad0e-44c9380987ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78100aa4-051a-4d46-ad0e-44c9380987ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150104803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8b179b-535a-4f36-803c-f9bd6e106f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56c49beec4747b2ac72c5c63b043d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:35Z,use_quota=True,user_id='d8305d36fd2d44898be4a4a1bcdca485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ccd447-85c6-4415-a27a-a2ee7a4ba829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ccd447-85c6-4415-a27a-a2ee7a4ba829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01750048-028a-4933-9aa5-75a77feb194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01750048-028a-4933-9aa5-75a77feb194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8b179b-535a-4f36-803c-f9bd6e106f7d', 'volume_name': 'volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7773e15a-18a5-46ad-a1a5-a11e2f12daef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7773e15a-18a5-46ad-a1a5-a11e2f12daef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bf6a38-c89b-41a0-b8fd-8ee907c90604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:35 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Volume cd8b179b-535a-4f36-803c-f9bd6e106f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d', 'volume_size': 1} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:35 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2" returned: 0 in 0.443s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:35 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 Jul 23 10:38:35 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:35 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:39 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08" returned: 0 in 4.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:39 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee7b5b5-b9e5-4332-88d5-729f7d08b9cd]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:39 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 Jul 23 10:38:39 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:40 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2" returned: 0 in 0.518s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2, size 1024.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:38:40 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Converted 1024.00 MB image at 240.85 MB/s Jul 23 10:38:40 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 is being set with open permissions: ugo+rw Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:40 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 Jul 23 10:38:40 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:40 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08" returned: 0 in 0.238s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-101c10ee-0920-4504-9ee0-b93bfbdaae08" released by "_copy_volume_from_snapshot" :: held 5.983s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-b834a697-366d-4ad2-988e-a471c07ab2e9-101c10ee-0920-4504-9ee0-b93bfbdaae08" released by "_create_volume_from_snapshot" :: held 6.029s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.060s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.085s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150104803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8b179b-535a-4f36-803c-f9bd6e106f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56c49beec4747b2ac72c5c63b043d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:35Z,use_quota=True,user_id='d8305d36fd2d44898be4a4a1bcdca485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Creating volume cd8b179b-535a-4f36-803c-f9bd6e106f7d {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:40 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:40 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d 1073741824 Jul 23 10:38:40 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a60529-2eb1-44ad-9b67-2fcb6329e486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101c10ee-0920-4504-9ee0-b93bfbdaae08', 'volume_size': 1, 'snapshot_id': 'b834a697-366d-4ad2-988e-a471c07ab2e9'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4faec872-7dcd-4d5d-9761-eb8c121d64bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:40 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Volume volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 (101c10ee-0920-4504-9ee0-b93bfbdaae08): created successfully Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4faec872-7dcd-4d5d-9761-eb8c121d64bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Flow 'volume_create_manager' (30261fdf-4044-4a7d-99b3-7bd9181cd231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:40 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-866141c5-ffc3-46d2-a793-b454658df1aa tempest-VolumeDependencyTests-1626644530 None] Created volume successfully. Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "cinder-b834a697-366d-4ad2-988e-a471c07ab2e9-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-b834a697-366d-4ad2-988e-a471c07ab2e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "cinder-quobyte-dcb825be-b5f1-4e1e-a513-452a6d6586a2" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-dcb825be-b5f1-4e1e-a513-452a6d6586a2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "cinder-quobyte-b834a697-366d-4ad2-988e-a471c07ab2e9" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-b834a697-366d-4ad2-988e-a471c07ab2e9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Deleting offline snapshot b834a697-366d-4ad2-988e-a471c07ab2e9 of volume dcb825be-b5f1-4e1e-a513-452a6d6586a2 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] snapshot_file for this snap is: volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:38:41 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d 1073741824" returned: 0 in 0.500s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[32657f8f-5984-401c-b710-82ca50c2a3e5]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:41 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d Jul 23 10:38:41 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:41 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 Jul 23 10:38:41 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:41 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d" returned: 0 in 0.255s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.511s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bf6a38-c89b-41a0-b8fd-8ee907c90604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad19e947-7dae-4f3b-8ce6-4a90e0a094e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] Creating offline snapshot dbfad383-8d03-407b-b4fb-a61536028d85 of volume 9f4fcf06-fc51-4426-a7c0-9642f03132d1 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:38:41 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Volume volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d (cd8b179b-535a-4f36-803c-f9bd6e106f7d): created successfully Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad19e947-7dae-4f3b-8ce6-4a90e0a094e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Flow 'volume_create_manager' (1e997d23-de8b-407b-9da5-1b3233f061cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[21480f82-d99e-4d61-943b-907936a4de75]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:41 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9" returned: 0 in 0.392s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:38:41 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-81fe5e93-2387-4a5a-a762-9081ed03a851 tempest-ProjectReaderTests-1355507435 None] Created volume successfully. Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59531df-ddd2-4441-b0ad-dab36a1f6802]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:41 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 Jul 23 10:38:41 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:41 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 Jul 23 10:38:41 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:41 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1" returned: 0 in 0.357s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:41 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 1G Jul 23 10:38:41 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:41 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:41 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 Jul 23 10:38:41 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:42 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9" returned: 0 in 0.362s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:42 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 1G" returned: 0 in 0.473s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:42 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9 Jul 23 10:38:42 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:42 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 Jul 23 10:38:42 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:42 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2.b834a697-366d-4ad2-988e-a471c07ab2e9" returned: 0 in 0.267s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-b834a697-366d-4ad2-988e-a471c07ab2e9" released by "_delete_snapshot" :: held 1.520s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:42 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-dcb825be-b5f1-4e1e-a513-452a6d6586a2" released by "delete_snapshot" :: held 1.546s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85" returned: 0 in 0.298s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:42 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 is being set with open permissions: ugo+rw Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:42 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 Jul 23 10:38:42 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Created reservations ['83dd66ef-097d-4635-aee3-48dde111c8eb', '9115d0fd-bd92-4a1a-964b-1a7240fe9419', '0f521209-c139-42b3-ae57-574674497638', '494bff6e-7965-4a10-88da-014373b6d81c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:42 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Delete snapshot completed successfully. Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5b53ec75-b208-4c18-94ec-5df047e42417 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-b834a697-366d-4ad2-988e-a471c07ab2e9-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:42 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:42 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.info Jul 23 10:38:42 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:43 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.info" returned: 0 in 0.275s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:43 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.info is being set with open permissions: ugo+rw Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:43 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.info Jul 23 10:38:43 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "cinder-dcb825be-b5f1-4e1e-a513-452a6d6586a2-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-dcb825be-b5f1-4e1e-a513-452a6d6586a2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "cinder-quobyte-dcb825be-b5f1-4e1e-a513-452a6d6586a2" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-dcb825be-b5f1-4e1e-a513-452a6d6586a2" acquired by "delete_volume" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c0ab74-4bcf-468b-b598-ac0a86677452]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:43 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:43 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 Jul 23 10:38:43 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.info" returned: 0 in 0.277s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.245s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] Creating offline snapshot d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 of volume cd8b179b-535a-4f36-803c-f9bd6e106f7d {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:38:43 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-e5e2d923-15f7-4a94-a903-cd98a84c83f9 tempest-ProjectMemberTests-1385482585 None] Create snapshot completed successfully Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb77ad9-b799-434a-b13f-4d4d603b2f9b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:43 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d Jul 23 10:38:43 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:43 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2" returned: 0 in 0.373s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:43 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2 Jul 23 10:38:43 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:43 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d" returned: 0 in 0.377s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:43 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 1G Jul 23 10:38:43 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:43 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-dcb825be-b5f1-4e1e-a513-452a6d6586a2" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-dcb825be-b5f1-4e1e-a513-452a6d6586a2" released by "delete_volume" :: held 0.683s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Created reservations ['18feb549-b573-4261-a896-37d0beae94b9', 'ea568497-f398-44f5-bc05-81f06c0ebd09', 'd96d2728-b23c-4c18-83bd-d4d9b31191f9', 'fca072b7-356b-4548-b5b8-174ca673d5bc'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:44 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:44 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:44 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 1G" returned: 0 in 0.424s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:44 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 Jul 23 10:38:44 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-dbfad383-8d03-407b-b4fb-a61536028d85-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-dbfad383-8d03-407b-b4fb-a61536028d85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-9f4fcf06-fc51-4426-a7c0-9642f03132d1" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-9f4fcf06-fc51-4426-a7c0-9642f03132d1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-dbfad383-8d03-407b-b4fb-a61536028d85" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-dbfad383-8d03-407b-b4fb-a61536028d85" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Deleting offline snapshot dbfad383-8d03-407b-b4fb-a61536028d85 of volume 9f4fcf06-fc51-4426-a7c0-9642f03132d1 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] snapshot_file for this snap is: volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "cinder-101c10ee-0920-4504-9ee0-b93bfbdaae08-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c00857-9872-4319-8190-78be48de8a38]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:44 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.306s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-101c10ee-0920-4504-9ee0-b93bfbdaae08-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:44 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Deleted volume successfully. Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5e98c921-372e-4a68-badb-538a488b5282 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-dcb825be-b5f1-4e1e-a513-452a6d6586a2-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "cinder-quobyte-101c10ee-0920-4504-9ee0-b93bfbdaae08" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-101c10ee-0920-4504-9ee0-b93bfbdaae08" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b8497a-9fb0-4003-aa3b-109f78c1200e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:44 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 Jul 23 10:38:44 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:44 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029" returned: 0 in 0.402s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:44 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 is being set with open permissions: ugo+rw Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:44 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 Jul 23 10:38:44 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:44 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 Jul 23 10:38:44 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:44 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85" returned: 0 in 0.423s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc201201-72e0-4477-9994-385f4c736bc1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:44 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029" returned: 0 in 0.255s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:44 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:44 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.info Jul 23 10:38:44 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08" returned: 0 in 0.400s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:45 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08 Jul 23 10:38:45 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:45 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 Jul 23 10:38:45 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:45 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.info" returned: 0 in 0.272s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:45 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.info is being set with open permissions: ugo+rw Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:45 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.info Jul 23 10:38:45 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:45 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-101c10ee-0920-4504-9ee0-b93bfbdaae08" returned: 0 in 0.276s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-quobyte-101c10ee-0920-4504-9ee0-b93bfbdaae08" released by "delete_volume" :: held 0.728s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:45 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1" returned: 0 in 0.386s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:45 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 Jul 23 10:38:45 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Created reservations ['0722955d-ba72-4051-8302-bee47c5e0834', '33b9283b-2494-4681-84f8-f74759fca543', 'e5a3009f-81e8-4d18-baa6-5c2ea04acb6a', '0a3e7c26-dc10-4155-b0bb-3601eba3d04b'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:45 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:45 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:45 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.info" returned: 0 in 0.290s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:45 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9da7b0a8-9d88-4fb8-a450-7fa5153bf829 tempest-ProjectReaderTests-1355507435 None] Create snapshot completed successfully Jul 23 10:38:45 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:45 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.277s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85" returned: 0 in 0.411s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:45 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Deleted volume successfully. Jul 23 10:38:45 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85 Jul 23 10:38:45 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5610ed13-2749-4e3d-8272-12575e44fd13 tempest-VolumeDependencyTests-1626644530 None] Lock "cinder-101c10ee-0920-4504-9ee0-b93bfbdaae08-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:45 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1.dbfad383-8d03-407b-b4fb-a61536028d85" returned: 0 in 0.267s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-dbfad383-8d03-407b-b4fb-a61536028d85" released by "_delete_snapshot" :: held 1.617s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-9f4fcf06-fc51-4426-a7c0-9642f03132d1" released by "delete_snapshot" :: held 1.647s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Created reservations ['1f7e4abe-e731-493e-9747-fdc53cf0442e', '95bf7b8c-a5b8-45d0-b80a-9796ca121ae6', 'aa015368-3659-41d0-9d5a-b10f5a53bff1', '6e4659aa-9a0f-4fad-b65a-635e390a39a1'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:46 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Delete snapshot completed successfully. Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-338f8477-62a7-4b90-acdd-bc67a7e93f49 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-dbfad383-8d03-407b-b4fb-a61536028d85-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:46 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:46 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-d9f3494a-8cb4-4832-9dd0-a4ecf04b3029-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-d9f3494a-8cb4-4832-9dd0-a4ecf04b3029-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-cd8b179b-535a-4f36-803c-f9bd6e106f7d" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-cd8b179b-535a-4f36-803c-f9bd6e106f7d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-d9f3494a-8cb4-4832-9dd0-a4ecf04b3029" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-d9f3494a-8cb4-4832-9dd0-a4ecf04b3029" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Deleting offline snapshot d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 of volume cd8b179b-535a-4f36-803c-f9bd6e106f7d {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] snapshot_file for this snap is: volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[85194c68-d9eb-4c66-892f-44a2262d8ada]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-9f4fcf06-fc51-4426-a7c0-9642f03132d1-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-9f4fcf06-fc51-4426-a7c0-9642f03132d1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:46 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.346s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-9f4fcf06-fc51-4426-a7c0-9642f03132d1" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-9f4fcf06-fc51-4426-a7c0-9642f03132d1" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc2ee3f-c87b-452c-94ad-c0f213645ad9]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:46 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 Jul 23 10:38:46 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:46 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 Jul 23 10:38:46 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:46 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029" returned: 0 in 0.460s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c7bf85-d2b1-4f74-a71b-a39e2441f86d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:47 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1" returned: 0 in 0.442s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:47 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1 Jul 23 10:38:47 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:47 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d Jul 23 10:38:47 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:47 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-9f4fcf06-fc51-4426-a7c0-9642f03132d1" returned: 0 in 0.287s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:47 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d" returned: 0 in 0.422s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-9f4fcf06-fc51-4426-a7c0-9642f03132d1" released by "delete_volume" :: held 0.815s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:47 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 Jul 23 10:38:47 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Created reservations ['3c6c71fa-1498-4c4d-bc38-c26a21da38ab', '5aeda721-899a-4923-ad1b-b19c063066da', 'd5314e63-3372-4f4c-a851-874537658698', '53dce20c-dd61-4a76-96f4-127bc5cb57d5'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:47 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:47 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:47 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.290s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:47 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029" returned: 0 in 0.459s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:47 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Deleted volume successfully. Jul 23 10:38:47 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029 Jul 23 10:38:47 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:47 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-082a87ec-18a8-43f7-9522-abb87a7b8958 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-9f4fcf06-fc51-4426-a7c0-9642f03132d1-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:48 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d.d9f3494a-8cb4-4832-9dd0-a4ecf04b3029" returned: 0 in 0.291s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-d9f3494a-8cb4-4832-9dd0-a4ecf04b3029" released by "_delete_snapshot" :: held 1.775s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-cd8b179b-535a-4f36-803c-f9bd6e106f7d" released by "delete_snapshot" :: held 1.809s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Created reservations ['e625ae64-934e-4c8d-84f5-2b41e10d1893', 'd5b2a04d-8ee5-4f84-bc53-f049df792256', 'c958f2f5-3bc5-4072-8d50-81dba80b6ee8', 'b80a8fbe-845b-495f-b73c-adc4c48c91e9'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (7a7105ce-309a-4ae1-8c59-51977ef2a04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bd1c8c-ebae-4828-93c7-6648bc56d765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bd1c8c-ebae-4828-93c7-6648bc56d765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477413784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e683c8a-35dd-498e-99fd-5535a7b523c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:48Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac636c14-ab30-4b55-8710-9c9908fd1cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac636c14-ab30-4b55-8710-9c9908fd1cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c8f2df-d6fc-42b1-83c1-b0f4fdb736b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c8f2df-d6fc-42b1-83c1-b0f4fdb736b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e683c8a-35dd-498e-99fd-5535a7b523c1', 'volume_name': 'volume-2e683c8a-35dd-498e-99fd-5535a7b523c1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea56051-3063-487e-b984-3fc772a4eb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea56051-3063-487e-b984-3fc772a4eb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ab1a81-263b-4db8-b281-1c3b2bcfdc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:48 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Volume 2e683c8a-35dd-498e-99fd-5535a7b523c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e683c8a-35dd-498e-99fd-5535a7b523c1', 'volume_size': 1} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477413784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e683c8a-35dd-498e-99fd-5535a7b523c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:48Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Creating volume 2e683c8a-35dd-498e-99fd-5535a7b523c1 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:48 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:48 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 1073741824 Jul 23 10:38:48 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:48 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Delete snapshot completed successfully. Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b4f21217-63ec-4024-be0d-6aa95b575e19 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-d9f3494a-8cb4-4832-9dd0-a4ecf04b3029-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:48 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 1073741824" returned: 0 in 0.510s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:49 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 Jul 23 10:38:49 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:49 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1" returned: 0 in 0.247s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ab1a81-263b-4db8-b281-1c3b2bcfdc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e683c8a-35dd-498e-99fd-5535a7b523c1', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d536d77-3465-4545-94b4-e1f07f96e299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:49 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Volume volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 (2e683c8a-35dd-498e-99fd-5535a7b523c1): created successfully Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d536d77-3465-4545-94b4-e1f07f96e299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (7a7105ce-309a-4ae1-8c59-51977ef2a04b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:49 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-32714c5b-f78e-4de2-91a7-51b67843f3d6 tempest-ProjectMemberTests-1385482585 None] Created volume successfully. Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-3d7c5f08-cc20-4a22-9fa2-adeb1801618b tempest-ProjectAdminTests-261259527 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88371) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-cd8b179b-535a-4f36-803c-f9bd6e106f7d-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-cd8b179b-535a-4f36-803c-f9bd6e106f7d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "cinder-quobyte-cd8b179b-535a-4f36-803c-f9bd6e106f7d" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-cd8b179b-535a-4f36-803c-f9bd6e106f7d" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc65256f-be2d-482d-b00f-894a02dbebeb]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:49 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:49 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d Jul 23 10:38:49 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:50 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d" returned: 0 in 0.378s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:50 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d Jul 23 10:38:50 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:50 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-cd8b179b-535a-4f36-803c-f9bd6e106f7d" returned: 0 in 0.270s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-quobyte-cd8b179b-535a-4f36-803c-f9bd6e106f7d" released by "delete_volume" :: held 0.722s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Created reservations ['19440332-9a66-46e2-9dc1-d877232053cf', 'ef41bab1-982a-4bed-ae7b-ec65add3db47', '11255f9f-346d-43be-b2ce-a1be60869cc4', '693ea7c1-9bf3-4808-89a4-44ac8f0aac34'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:50 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:50 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] Creating offline snapshot 2c7b7b39-531e-41a3-9f5f-20c274040787 of volume 2e683c8a-35dd-498e-99fd-5535a7b523c1 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c1a7a3-31ff-4bda-b8f9-0d000b46df32]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:50 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 Jul 23 10:38:50 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:50 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.316s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:50 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Deleted volume successfully. Jul 23 10:38:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f6353525-3e44-4de1-99d7-1642abe38491 tempest-ProjectReaderTests-1355507435 None] Lock "cinder-cd8b179b-535a-4f36-803c-f9bd6e106f7d-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:51 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1" returned: 0 in 0.497s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:51 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 1G Jul 23 10:38:51 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:51 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 1G" returned: 0 in 0.481s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:51 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 Jul 23 10:38:51 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:52 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787" returned: 0 in 0.342s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:52 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 is being set with open permissions: ugo+rw Jul 23 10:38:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:52 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 Jul 23 10:38:52 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:52 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787" returned: 0 in 0.255s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:52 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.info Jul 23 10:38:52 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:52 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.info" returned: 0 in 0.306s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:52 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.info is being set with open permissions: ugo+rw Jul 23 10:38:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:52 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.info Jul 23 10:38:52 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:52 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.info" returned: 0 in 0.296s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:52 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:52 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8fddc51f-ea26-4fef-b23f-d97658fbc130 tempest-ProjectMemberTests-1385482585 None] Create snapshot completed successfully Jul 23 10:38:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-2c7b7b39-531e-41a3-9f5f-20c274040787-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-2c7b7b39-531e-41a3-9f5f-20c274040787-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-2e683c8a-35dd-498e-99fd-5535a7b523c1" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-2e683c8a-35dd-498e-99fd-5535a7b523c1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-2c7b7b39-531e-41a3-9f5f-20c274040787" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-2c7b7b39-531e-41a3-9f5f-20c274040787" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Deleting offline snapshot 2c7b7b39-531e-41a3-9f5f-20c274040787 of volume 2e683c8a-35dd-498e-99fd-5535a7b523c1 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:38:53 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] snapshot_file for this snap is: volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:38:53 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1933b0-12e2-4b04-8751-4a50463efe9b]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:53 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:54 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 Jul 23 10:38:54 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:54 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787" returned: 0 in 0.406s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:54 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e683c8a-35dd-498e-99fd-5535a7b523c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:38:54 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7eb891-3e4a-4863-8508-23543f4d9fe9]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:54 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 Jul 23 10:38:54 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:54 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1" returned: 0 in 0.480s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:54 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:54 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 Jul 23 10:38:54 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:55 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787" returned: 0 in 0.411s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:55 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787 Jul 23 10:38:55 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:55 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1.2c7b7b39-531e-41a3-9f5f-20c274040787" returned: 0 in 0.257s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-2c7b7b39-531e-41a3-9f5f-20c274040787" released by "_delete_snapshot" :: held 1.683s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-2e683c8a-35dd-498e-99fd-5535a7b523c1" released by "delete_snapshot" :: held 1.709s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:55 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Created reservations ['90ebe42b-ae4d-4fba-a1e6-56f840b90ff9', 'cab1b3e2-9b3b-4fd2-88cb-59f1ea1d4195', '9b6e3766-477d-41d2-a3ac-94fa631063cd', 'f7ec82dd-125a-4235-88c1-3ede67dd9a4e'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:55 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Delete snapshot completed successfully. Jul 23 10:38:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8adcfe69-e9fe-4060-8875-c22c34e1f406 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-2c7b7b39-531e-41a3-9f5f-20c274040787-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-2e683c8a-35dd-498e-99fd-5535a7b523c1-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-2e683c8a-35dd-498e-99fd-5535a7b523c1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-2e683c8a-35dd-498e-99fd-5535a7b523c1" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:38:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-2e683c8a-35dd-498e-99fd-5535a7b523c1" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:38:56 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[15124af7-1073-4bdc-abce-a94d3e64bc22]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:56 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 Jul 23 10:38:56 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:56 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1" returned: 0 in 0.427s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:56 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1 Jul 23 10:38:56 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:56 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-2e683c8a-35dd-498e-99fd-5535a7b523c1" returned: 0 in 0.296s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-2e683c8a-35dd-498e-99fd-5535a7b523c1" released by "delete_volume" :: held 0.794s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Created reservations ['cd4238b2-840c-47ce-a5de-6c2740c94340', '6d472079-36a4-48c4-a051-3f3670b9318f', 'b0f3babd-a3c7-4c1a-a463-8ecdf4383a14', '4edf1fbc-efd8-4de8-8dec-5708336a1493'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:57 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:38:57 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:57 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.304s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:38:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Deleted volume successfully. Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-287783d8-11cf-443f-a391-2293fd68ea3b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-2e683c8a-35dd-498e-99fd-5535a7b523c1-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (489b576f-1d6b-41b7-be41-97758b223623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c54c8d0-ec8e-4c21-a6d3-f3160d1ed0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c54c8d0-ec8e-4c21-a6d3-f3160d1ed0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938439270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3299449e-24bd-4a2a-ad67-d01508f8dcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:58Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb204f6-ca2f-4cd3-8198-bafe0d87b120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb204f6-ca2f-4cd3-8198-bafe0d87b120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c752b4fe-af34-4117-a921-6c386e8e90ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c752b4fe-af34-4117-a921-6c386e8e90ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3299449e-24bd-4a2a-ad67-d01508f8dcc5', 'volume_name': 'volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e60432-ef4d-42a5-a722-3a463ad49dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e60432-ef4d-42a5-a722-3a463ad49dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39bbbba-b7a4-4d4a-99bc-68fe248099df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:57 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Volume 3299449e-24bd-4a2a-ad67-d01508f8dcc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5', 'volume_size': 1} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938439270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3299449e-24bd-4a2a-ad67-d01508f8dcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:38:58Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Creating volume 3299449e-24bd-4a2a-ad67-d01508f8dcc5 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:38:57 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:38:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:57 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 1073741824 Jul 23 10:38:57 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:58 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 1073741824" returned: 0 in 0.496s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:58 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 Jul 23 10:38:58 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:58 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5" returned: 0 in 0.270s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:38:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:38:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39bbbba-b7a4-4d4a-99bc-68fe248099df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21c2c18-e737-4030-b60b-e58af4fb02d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:38:58 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Volume volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 (3299449e-24bd-4a2a-ad67-d01508f8dcc5): created successfully Jul 23 10:38:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21c2c18-e737-4030-b60b-e58af4fb02d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:38:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (489b576f-1d6b-41b7-be41-97758b223623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:38:58 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-9f5b2eaf-e029-4213-87c9-47978fee1f79 tempest-ProjectMemberTests-1385482585 None] Created volume successfully. Jul 23 10:38:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:38:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:38:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] Creating offline snapshot ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f of volume 3299449e-24bd-4a2a-ad67-d01508f8dcc5 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:38:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[51608afb-5be6-4a02-a9ae-5a1f6be8f33e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:38:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:59 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 Jul 23 10:38:59 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:38:59 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 23 10:38:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5" returned: 0 in 0.410s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:38:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:38:59 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f 1G Jul 23 10:38:59 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:00 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f 1G" returned: 0 in 0.475s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:00 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f Jul 23 10:39:00 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:00 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f" returned: 0 in 0.389s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:00 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f is being set with open permissions: ugo+rw Jul 23 10:39:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:00 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f Jul 23 10:39:00 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:00 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f" returned: 0 in 0.269s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:00 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.info Jul 23 10:39:00 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:01 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.info" returned: 0 in 0.257s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:01 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.info is being set with open permissions: ugo+rw Jul 23 10:39:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:01 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.info Jul 23 10:39:01 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:01 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.info" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-50ddafdf-6cbc-4490-a3b7-798bcf02605d tempest-ProjectMemberTests-1385482585 None] Create snapshot completed successfully Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-3299449e-24bd-4a2a-ad67-d01508f8dcc5" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-3299449e-24bd-4a2a-ad67-d01508f8dcc5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Deleting offline snapshot ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f of volume 3299449e-24bd-4a2a-ad67-d01508f8dcc5 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] snapshot_file for this snap is: volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a6938d-fc79-4882-bc3d-e0c9d3544f61]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:02 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f Jul 23 10:39:02 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:02 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f" returned: 0 in 0.383s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb7a81d-c6c8-4468-8dee-8c6ed73b25d3]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:02 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 Jul 23 10:39:02 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:03 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5" returned: 0 in 0.356s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:03 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f Jul 23 10:39:03 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:03 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f" returned: 0 in 0.352s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:03 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f Jul 23 10:39:03 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:03 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5.ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f" returned: 0 in 0.239s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f" released by "_delete_snapshot" :: held 1.427s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-3299449e-24bd-4a2a-ad67-d01508f8dcc5" released by "delete_snapshot" :: held 1.453s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:03 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Created reservations ['c390e301-0229-4b7e-a4f9-2a6ed03b5cac', '299dab46-6f76-4902-ba22-809dba30fda3', 'c687668d-4a60-48bc-92ea-2bbfcd39c428', '7abc8a6c-b957-421d-b9e9-72f673fdc9c8'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:03 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Delete snapshot completed successfully. Jul 23 10:39:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-7fe5fe92-0a8a-47fb-b922-848ddccaa753 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-ffac5dc0-32ea-4ead-8f7c-ebc18a9be48f-delete_snapshot" released by "delete_snapshot" :: held 1.604s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-3299449e-24bd-4a2a-ad67-d01508f8dcc5-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-3299449e-24bd-4a2a-ad67-d01508f8dcc5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-3299449e-24bd-4a2a-ad67-d01508f8dcc5" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-3299449e-24bd-4a2a-ad67-d01508f8dcc5" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:04 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f389ad9-33b3-4915-b39f-767b09043f60]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:04 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 Jul 23 10:39:04 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:04 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5" returned: 0 in 0.379s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:05 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5 Jul 23 10:39:05 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:05 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-3299449e-24bd-4a2a-ad67-d01508f8dcc5" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-3299449e-24bd-4a2a-ad67-d01508f8dcc5" released by "delete_volume" :: held 0.691s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Created reservations ['419440ab-9c0e-4ff5-9fee-5df8e5412171', '976b13d9-5410-40b9-b5f5-c2b8a1b93239', '531bb7b6-957f-4cea-8f86-bec91a417e2d', '0d8d2022-e0bb-49a2-a13a-cbfebb28e56c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:05 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:39:05 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:05 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.241s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:39:05 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Deleted volume successfully. Jul 23 10:39:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-72fa4cd6-b303-4ddf-9d16-9146455a8da2 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-3299449e-24bd-4a2a-ad67-d01508f8dcc5-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (f1865377-54dd-4c92-8be4-01e2a2f161ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38f67b4-9184-4a3e-845e-a899172cd5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38f67b4-9184-4a3e-845e-a899172cd5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545236822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c59bede-cbca-4b11-8be4-365871547c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:06Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf47421-4d22-41e3-ba36-f18ea0f6d791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf47421-4d22-41e3-ba36-f18ea0f6d791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5ba8ae-7c10-4edd-9090-c7de16c07769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5ba8ae-7c10-4edd-9090-c7de16c07769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c59bede-cbca-4b11-8be4-365871547c1d', 'volume_name': 'volume-8c59bede-cbca-4b11-8be4-365871547c1d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf9582c-57ef-4e52-8fa9-55fb2b3f56a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf9582c-57ef-4e52-8fa9-55fb2b3f56a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc89b8fb-3221-45bb-bfca-5e21cead9201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:06 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Volume 8c59bede-cbca-4b11-8be4-365871547c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c59bede-cbca-4b11-8be4-365871547c1d', 'volume_size': 1} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545236822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c59bede-cbca-4b11-8be4-365871547c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:06Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Creating volume 8c59bede-cbca-4b11-8be4-365871547c1d {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:39:06 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:06 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d 1073741824 Jul 23 10:39:06 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:06 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d 1073741824" returned: 0 in 0.440s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:06 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d Jul 23 10:39:06 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:06 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d" returned: 0 in 0.263s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc89b8fb-3221-45bb-bfca-5e21cead9201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c59bede-cbca-4b11-8be4-365871547c1d', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:06 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04152c87-5334-40e3-877f-db8532bbb95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:06 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Volume volume-8c59bede-cbca-4b11-8be4-365871547c1d (8c59bede-cbca-4b11-8be4-365871547c1d): created successfully Jul 23 10:39:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04152c87-5334-40e3-877f-db8532bbb95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:07 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (f1865377-54dd-4c92-8be4-01e2a2f161ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:07 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-61479710-63c2-4f7e-85ad-e747710d905e tempest-ProjectMemberTests-1385482585 None] Created volume successfully. Jul 23 10:39:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:07 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] Creating offline snapshot 84658f7d-8d78-401d-b45b-47a359479a51 of volume 8c59bede-cbca-4b11-8be4-365871547c1d {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:39:07 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af365b6-4b9a-4e8b-8a23-95ea70dca894]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:07 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d Jul 23 10:39:07 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:07 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d" returned: 0 in 0.355s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:07 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:07 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 1G Jul 23 10:39:07 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:08 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 1G" returned: 0 in 0.419s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c59bede-cbca-4b11-8be4-365871547c1d -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:08 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c59bede-cbca-4b11-8be4-365871547c1d -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 Jul 23 10:39:08 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c59bede-cbca-4b11-8be4-365871547c1d -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51" returned: 0 in 0.300s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:08 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 is being set with open permissions: ugo+rw Jul 23 10:39:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:08 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:08 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 Jul 23 10:39:08 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:08 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51" returned: 0 in 0.262s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:08 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.info Jul 23 10:39:08 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:08 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.info" returned: 0 in 0.306s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:08 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.info is being set with open permissions: ugo+rw Jul 23 10:39:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:09 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.info Jul 23 10:39:09 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:09 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.info" returned: 0 in 0.244s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:09 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8c75f2c0-3f0f-4db9-97cd-34f3f94eaefd tempest-ProjectMemberTests-1385482585 None] Create snapshot completed successfully Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-84658f7d-8d78-401d-b45b-47a359479a51-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-84658f7d-8d78-401d-b45b-47a359479a51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-8c59bede-cbca-4b11-8be4-365871547c1d" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-8c59bede-cbca-4b11-8be4-365871547c1d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-84658f7d-8d78-401d-b45b-47a359479a51" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-84658f7d-8d78-401d-b45b-47a359479a51" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Deleting offline snapshot 84658f7d-8d78-401d-b45b-47a359479a51 of volume 8c59bede-cbca-4b11-8be4-365871547c1d {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] snapshot_file for this snap is: volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[7129298a-6425-4e2a-a6ff-aabae1261606]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:09 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 Jul 23 10:39:09 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:09 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51" returned: 0 in 0.347s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c59bede-cbca-4b11-8be4-365871547c1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07b0e98-8e42-4aa6-8d5a-e95d8cfd00e7]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:09 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d Jul 23 10:39:09 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:10 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d" returned: 0 in 0.387s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:10 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 Jul 23 10:39:10 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:10 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51" returned: 0 in 0.354s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:10 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51 Jul 23 10:39:10 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:10 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d.84658f7d-8d78-401d-b45b-47a359479a51" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-84658f7d-8d78-401d-b45b-47a359479a51" released by "_delete_snapshot" :: held 1.449s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-8c59bede-cbca-4b11-8be4-365871547c1d" released by "delete_snapshot" :: held 1.473s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:10 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Created reservations ['eb385d64-9345-47e9-8c1e-0f9b1fcf7e13', 'd234f39f-5c61-4b03-925c-a67936d5cbb7', '79ba9c19-e749-4e09-922c-7c27c0373a21', 'ed5b65ee-d1d2-460e-8c95-9c440bfd121c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:11 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Delete snapshot completed successfully. Jul 23 10:39:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b3fc529d-3f3a-441f-8871-7bcdcc39cb25 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-84658f7d-8d78-401d-b45b-47a359479a51-delete_snapshot" released by "delete_snapshot" :: held 1.618s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-8c59bede-cbca-4b11-8be4-365871547c1d-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Lock "cinder-8c59bede-cbca-4b11-8be4-365871547c1d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-8c59bede-cbca-4b11-8be4-365871547c1d" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-8c59bede-cbca-4b11-8be4-365871547c1d" acquired by "delete_volume" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:11 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6b8add-99bb-474a-a878-ed7ea4d63843]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:11 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d Jul 23 10:39:11 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:12 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d" returned: 0 in 0.364s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:12 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d Jul 23 10:39:12 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:12 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-8c59bede-cbca-4b11-8be4-365871547c1d" returned: 0 in 0.301s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-8c59bede-cbca-4b11-8be4-365871547c1d" released by "delete_volume" :: held 0.724s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Created reservations ['34b783ef-5672-4511-93c9-de0d577cb424', '1746e27f-55a7-4fad-bfd1-480114c823d0', '0151cbf5-92ae-458b-a780-c30ae7394270', 'a626e4a0-b637-4431-bce0-6b3a954929d5'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:12 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:39:12 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:12 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.249s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:39:12 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Deleted volume successfully. Jul 23 10:39:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-f05c49f1-6857-46b6-85d9-353d1e1327ab tempest-ProjectMemberTests-1385482585 None] Lock "cinder-8c59bede-cbca-4b11-8be4-365871547c1d-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (6a2a5857-4dfc-4c91-b30b-ab0f97b2e361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe597323-7437-4346-9dfe-d17e664b9a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe597323-7437-4346-9dfe-d17e664b9a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955037617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943444cf-6db9-4458-ad27-fc0d9e9ee877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:13Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f70312e-42d9-4db0-84b3-f3458a5ea08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f70312e-42d9-4db0-84b3-f3458a5ea08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f32f79d-1b26-489e-8b0c-34c6e906a594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f32f79d-1b26-489e-8b0c-34c6e906a594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943444cf-6db9-4458-ad27-fc0d9e9ee877', 'volume_name': 'volume-943444cf-6db9-4458-ad27-fc0d9e9ee877', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dc76ed-027e-4cf0-8f07-1c3f56180cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dc76ed-027e-4cf0-8f07-1c3f56180cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b35f60-e1d5-4dbd-9310-f5bff32a000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:13 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Volume 943444cf-6db9-4458-ad27-fc0d9e9ee877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943444cf-6db9-4458-ad27-fc0d9e9ee877', 'volume_size': 1} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955037617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943444cf-6db9-4458-ad27-fc0d9e9ee877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:13Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Creating volume 943444cf-6db9-4458-ad27-fc0d9e9ee877 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:39:13 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:13 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 1073741824 Jul 23 10:39:13 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:13 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 1073741824" returned: 0 in 0.528s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:13 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 Jul 23 10:39:13 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:14 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877" returned: 0 in 0.312s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:14 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:39:14 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b35f60-e1d5-4dbd-9310-f5bff32a000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943444cf-6db9-4458-ad27-fc0d9e9ee877', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c31bba6-f10c-4a30-a64a-8419e4cfa754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:14 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Volume volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 (943444cf-6db9-4458-ad27-fc0d9e9ee877): created successfully Jul 23 10:39:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c31bba6-f10c-4a30-a64a-8419e4cfa754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:14 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (6a2a5857-4dfc-4c91-b30b-ab0f97b2e361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:14 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-bbaf6542-1545-48c4-a7f1-ee9bce31b75b tempest-ProjectMemberTests-1385482585 None] Created volume successfully. Jul 23 10:39:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:15 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] Creating offline snapshot 5955dcfb-20fe-4214-84ff-1507733196d9 of volume 943444cf-6db9-4458-ad27-fc0d9e9ee877 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:39:15 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[5267932c-a108-4425-b089-f6cbc674a11f]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:15 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 Jul 23 10:39:15 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:15 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877" returned: 0 in 0.380s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:15 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:15 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 1G Jul 23 10:39:15 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:16 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 1G" returned: 0 in 0.484s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:16 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 Jul 23 10:39:16 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:16 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9" returned: 0 in 0.340s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:16 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 is being set with open permissions: ugo+rw Jul 23 10:39:16 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:16 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 Jul 23 10:39:16 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:17 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9" returned: 0 in 0.282s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:17 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.info Jul 23 10:39:17 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:17 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.info" returned: 0 in 0.276s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:17 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.info is being set with open permissions: ugo+rw Jul 23 10:39:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:17 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.info Jul 23 10:39:17 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:17 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.info" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:17 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:17 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a43e6f4d-1ca8-4bcc-8bec-5e94b705f147 tempest-ProjectMemberTests-1385482585 None] Create snapshot completed successfully Jul 23 10:39:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-5955dcfb-20fe-4214-84ff-1507733196d9-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Lock "cinder-5955dcfb-20fe-4214-84ff-1507733196d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-943444cf-6db9-4458-ad27-fc0d9e9ee877" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-943444cf-6db9-4458-ad27-fc0d9e9ee877" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-5955dcfb-20fe-4214-84ff-1507733196d9" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:18 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-5955dcfb-20fe-4214-84ff-1507733196d9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Deleting offline snapshot 5955dcfb-20fe-4214-84ff-1507733196d9 of volume 943444cf-6db9-4458-ad27-fc0d9e9ee877 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:39:18 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] snapshot_file for this snap is: volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:39:18 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[64997775-b74d-410d-be98-ef78be330103]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:18 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:18 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 Jul 23 10:39:18 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:19 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9" returned: 0 in 0.357s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:19 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943444cf-6db9-4458-ad27-fc0d9e9ee877(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:39:19 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5496e33-c96f-49dd-8077-be327b4ab6ca]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:19 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 Jul 23 10:39:19 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:19 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877" returned: 0 in 0.368s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:19 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 Jul 23 10:39:19 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:19 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9" returned: 0 in 0.350s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:19 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:19 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9 Jul 23 10:39:19 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:20 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877.5955dcfb-20fe-4214-84ff-1507733196d9" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-5955dcfb-20fe-4214-84ff-1507733196d9" released by "_delete_snapshot" :: held 1.413s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-943444cf-6db9-4458-ad27-fc0d9e9ee877" released by "delete_snapshot" :: held 1.434s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:20 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Created reservations ['87281f21-f5e7-4c69-bd26-7a37ac415d30', '02e1f965-c82d-4cda-a815-1f077a5701d7', '46fe4840-7409-40dc-a2e5-cb1f5375b364', 'e066e367-2537-4ecd-bf5d-94fdb69c1e2d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:20 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Delete snapshot completed successfully. Jul 23 10:39:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-c7e72421-fc3a-40c3-a2b3-dcdad59e48ab tempest-ProjectMemberTests-1385482585 None] Lock "cinder-5955dcfb-20fe-4214-84ff-1507733196d9-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-943444cf-6db9-4458-ad27-fc0d9e9ee877-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Lock "cinder-943444cf-6db9-4458-ad27-fc0d9e9ee877-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-943444cf-6db9-4458-ad27-fc0d9e9ee877" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:20 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-943444cf-6db9-4458-ad27-fc0d9e9ee877" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:20 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e3e7de-cea9-4609-8e60-6b4d09b96591]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:20 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:21 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 Jul 23 10:39:21 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:21 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877" returned: 0 in 0.382s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:21 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877 Jul 23 10:39:21 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:21 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-943444cf-6db9-4458-ad27-fc0d9e9ee877" returned: 0 in 0.397s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:21 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-943444cf-6db9-4458-ad27-fc0d9e9ee877" released by "delete_volume" :: held 0.844s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:21 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Created reservations ['960f2d1e-0547-4c4a-84ef-199aad4c3f83', 'f2ea01b6-b565-47d8-82f9-37374ba0b53b', '5b6acee7-3a4e-4d05-9692-31e960064e09', '5736556b-adae-41eb-b186-dba1d0dd7d50'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:21 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:21 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:21 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:39:21 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:22 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.270s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:39:22 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Deleted volume successfully. Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-19de99af-d710-424b-9c8d-878373d0ca4c tempest-ProjectMemberTests-1385482585 None] Lock "cinder-943444cf-6db9-4458-ad27-fc0d9e9ee877-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (f74ae714-198e-425a-9f29-77129e6baa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc27556f-db40-4823-ab00-a9d0b50b9c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc27556f-db40-4823-ab00-a9d0b50b9c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1378685356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c57384-1bff-4072-a258-4ad6b433d45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:23Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1eea4b-46ca-4f75-88d1-89be210f6224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1eea4b-46ca-4f75-88d1-89be210f6224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22573be-2463-46bb-a8de-dfed61811c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22573be-2463-46bb-a8de-dfed61811c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c57384-1bff-4072-a258-4ad6b433d45e', 'volume_name': 'volume-e2c57384-1bff-4072-a258-4ad6b433d45e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b83b05a-924f-40a2-8df0-e8fabb0299ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b83b05a-924f-40a2-8df0-e8fabb0299ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cf2d94-27dc-40ef-ae6a-b56aa85d079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:22 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Volume e2c57384-1bff-4072-a258-4ad6b433d45e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c57384-1bff-4072-a258-4ad6b433d45e', 'volume_size': 1} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1378685356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c57384-1bff-4072-a258-4ad6b433d45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:23Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Creating volume e2c57384-1bff-4072-a258-4ad6b433d45e {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:39:22 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:39:22 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:22 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e 1073741824 Jul 23 10:39:22 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:23 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e 1073741824" returned: 0 in 0.509s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:23 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e Jul 23 10:39:23 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:23 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e" returned: 0 in 0.284s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:23 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:39:23 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cf2d94-27dc-40ef-ae6a-b56aa85d079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c57384-1bff-4072-a258-4ad6b433d45e', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbdc78b-aef6-4fb9-bd61-afc679b56a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:23 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Volume volume-e2c57384-1bff-4072-a258-4ad6b433d45e (e2c57384-1bff-4072-a258-4ad6b433d45e): created successfully Jul 23 10:39:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbdc78b-aef6-4fb9-bd61-afc679b56a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:23 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (f74ae714-198e-425a-9f29-77129e6baa25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:23 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-2905c280-74bc-47b6-9361-0491a7a62331 tempest-ProjectMemberTests-1385482585 None] Created volume successfully. Jul 23 10:39:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:25 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] Creating offline snapshot 7c5a0f51-416a-4779-a077-e9d7504510ac of volume e2c57384-1bff-4072-a258-4ad6b433d45e {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:39:25 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[488acafe-a6c8-4155-9ab6-c49e783dc76c]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:25 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e Jul 23 10:39:25 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:25 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e" returned: 0 in 0.366s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:25 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac 1G Jul 23 10:39:25 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:25 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac 1G" returned: 0 in 0.475s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:25 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c57384-1bff-4072-a258-4ad6b433d45e -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:25 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c57384-1bff-4072-a258-4ad6b433d45e -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac Jul 23 10:39:25 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:26 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c57384-1bff-4072-a258-4ad6b433d45e -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac" returned: 0 in 0.325s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:26 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac is being set with open permissions: ugo+rw Jul 23 10:39:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:26 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac Jul 23 10:39:26 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:26 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac" returned: 0 in 0.271s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:26 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.info Jul 23 10:39:26 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:26 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.info" returned: 0 in 0.254s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:26 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.info is being set with open permissions: ugo+rw Jul 23 10:39:26 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:26 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.info Jul 23 10:39:26 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:27 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.info" returned: 0 in 0.251s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:27 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a8ee7e87-2489-424e-a0f7-6107cac1f4f9 tempest-ProjectMemberTests-1385482585 None] Create snapshot completed successfully Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Flow 'volume_create_manager' (adf6e5a0-c1a7-430d-952d-02840e9ef087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0950ac11-c03a-49dd-b2fc-97e2f6faf3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0950ac11-c03a-49dd-b2fc-97e2f6faf3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2027845556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836d0199-6641-41e5-9aa0-ca2e94dfddfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de3e84ed1e74241b772eac135555657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:27Z,use_quota=True,user_id='cb8263db1ca14d47af61829941d103d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a7344e-e9b0-4759-98cb-905ab899a3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a7344e-e9b0-4759-98cb-905ab899a3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0add72bc-f719-49cd-bd73-4670da0a395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0add72bc-f719-49cd-bd73-4670da0a395b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836d0199-6641-41e5-9aa0-ca2e94dfddfb', 'volume_name': 'volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ac9316-25cd-447b-b3bd-5121f8ab254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ac9316-25cd-447b-b3bd-5121f8ab254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4832de2-3821-485d-88e0-23017ca3a944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:27 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Volume 836d0199-6641-41e5-9aa0-ca2e94dfddfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb', 'volume_size': 1} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2027845556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836d0199-6641-41e5-9aa0-ca2e94dfddfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de3e84ed1e74241b772eac135555657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:27Z,use_quota=True,user_id='cb8263db1ca14d47af61829941d103d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Creating volume 836d0199-6641-41e5-9aa0-ca2e94dfddfb {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:39:27 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:27 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb 1073741824 Jul 23 10:39:27 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:27 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb 1073741824" returned: 0 in 0.389s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:27 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb Jul 23 10:39:27 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:27 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb" returned: 0 in 0.240s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4832de2-3821-485d-88e0-23017ca3a944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62889a94-1ff6-4fd0-8733-92aa75061d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:27 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Volume volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb (836d0199-6641-41e5-9aa0-ca2e94dfddfb): created successfully Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62889a94-1ff6-4fd0-8733-92aa75061d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:27 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Flow 'volume_create_manager' (adf6e5a0-c1a7-430d-952d-02840e9ef087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:27 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-a2306abc-bf53-4bfa-a765-add6adf5fa33 tempest-SnapshotDependencyTests-1910705127 None] Created volume successfully. Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-7c5a0f51-416a-4779-a077-e9d7504510ac-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Lock "cinder-7c5a0f51-416a-4779-a077-e9d7504510ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-e2c57384-1bff-4072-a258-4ad6b433d45e" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-e2c57384-1bff-4072-a258-4ad6b433d45e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-7c5a0f51-416a-4779-a077-e9d7504510ac" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-7c5a0f51-416a-4779-a077-e9d7504510ac" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Deleting offline snapshot 7c5a0f51-416a-4779-a077-e9d7504510ac of volume e2c57384-1bff-4072-a258-4ad6b433d45e {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] snapshot_file for this snap is: volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee24ace-1328-4ffa-acc5-662d14067ba1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:28 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac Jul 23 10:39:28 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:UPDATE=155,cinder:DELETE=15,cinder:SELECT=126,cinder:INSERT=46 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] Creating offline snapshot e5144927-cd7b-452f-992d-5f22646d789f of volume 836d0199-6641-41e5-9aa0-ca2e94dfddfb {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2701b8-5967-4c6f-a20e-f0744b5016ab]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:28 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb Jul 23 10:39:28 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:28 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac" returned: 0 in 0.366s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2c57384-1bff-4072-a258-4ad6b433d45e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b02ed64-5fad-4f14-b43f-f66e3c0f0aab]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:28 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e Jul 23 10:39:28 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:28 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb" returned: 0 in 0.372s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:28 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:28 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f 1G Jul 23 10:39:28 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:29 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e" returned: 0 in 0.370s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:29 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac Jul 23 10:39:29 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:29 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f 1G" returned: 0 in 0.379s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:29 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f Jul 23 10:39:29 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:29 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac" returned: 0 in 0.327s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:29 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac Jul 23 10:39:29 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:29 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f" returned: 0 in 0.324s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:29 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f is being set with open permissions: ugo+rw Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:29 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f Jul 23 10:39:29 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:29 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e.7c5a0f51-416a-4779-a077-e9d7504510ac" returned: 0 in 0.269s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-7c5a0f51-416a-4779-a077-e9d7504510ac" released by "_delete_snapshot" :: held 1.432s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-e2c57384-1bff-4072-a258-4ad6b433d45e" released by "delete_snapshot" :: held 1.456s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=131,cinder:UPDATE=159,cinder:INSERT=39,cinder:DELETE=13 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Created reservations ['6aa1655a-1d8c-4139-baad-f6d0b2d2286e', '3a8c190c-d0bb-491b-adcd-ccd019befb8e', '39778a30-2e59-4fa2-b7d1-13404547c4a1', 'a88b2cc9-98c4-4e66-b356-e667c78207da'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:29 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Delete snapshot completed successfully. Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-397ad9d1-53dc-45a6-ba0a-ee0b141c7bdb tempest-ProjectMemberTests-1385482585 None] Lock "cinder-7c5a0f51-416a-4779-a077-e9d7504510ac-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:29 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f" returned: 0 in 0.267s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:29 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:29 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.info Jul 23 10:39:29 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:30 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.info" returned: 0 in 0.244s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:30 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.info is being set with open permissions: ugo+rw Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:30 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.info Jul 23 10:39:30 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:30 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.info" returned: 0 in 0.247s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-e2c57384-1bff-4072-a258-4ad6b433d45e-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-e2c57384-1bff-4072-a258-4ad6b433d45e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:30 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8cc0d84a-8dd6-4259-81d0-6a496ca19765 tempest-SnapshotDependencyTests-1910705127 None] Create snapshot completed successfully Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-e2c57384-1bff-4072-a258-4ad6b433d45e" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-e2c57384-1bff-4072-a258-4ad6b433d45e" acquired by "delete_volume" :: waited 0.013s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a910f9-784b-4286-a962-86e800aef83d]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:30 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e Jul 23 10:39:30 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:30 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e" returned: 0 in 0.360s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:30 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:30 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e Jul 23 10:39:30 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:39:31 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e2c57384-1bff-4072-a258-4ad6b433d45e" returned: 0 in 0.276s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-e2c57384-1bff-4072-a258-4ad6b433d45e" released by "delete_volume" :: held 0.700s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Flow 'volume_create_manager' (8def061a-c88a-4dff-8a74-0709dfd9e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76bfdbf-adcb-40b7-a9ad-859684384c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76bfdbf-adcb-40b7-a9ad-859684384c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd016f1-5304-4d80-bbf4-0b33d1b30faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de3e84ed1e74241b772eac135555657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e5144927-cd7b-452f-992d-5f22646d789f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:31Z,use_quota=True,user_id='cb8263db1ca14d47af61829941d103d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fbbf25-9ef9-4469-bf91-1ccd55362714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fbbf25-9ef9-4469-bf91-1ccd55362714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509bc647-8a30-4a83-8f7a-2e456f4ee801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509bc647-8a30-4a83-8f7a-2e456f4ee801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bd016f1-5304-4d80-bbf4-0b33d1b30faf', 'volume_name': 'volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf', 'volume_size': 1, 'snapshot_id': 'e5144927-cd7b-452f-992d-5f22646d789f'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1a6b0d-02b5-405a-b8cf-4f170881d6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1a6b0d-02b5-405a-b8cf-4f170881d6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e7cff0-2792-4eee-91af-99b6028eabfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:31 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Volume 7bd016f1-5304-4d80-bbf4-0b33d1b30faf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf', 'volume_size': 1, 'snapshot_id': 'e5144927-cd7b-452f-992d-5f22646d789f'} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "cinder-quobyte-e5144927-cd7b-452f-992d-5f22646d789f-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" by "_create_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-e5144927-cd7b-452f-992d-5f22646d789f-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Creating volume 7bd016f1-5304-4d80-bbf4-0b33d1b30faf from snapshot e5144927-cd7b-452f-992d-5f22646d789f {{(pid=88371) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "cinder-quobyte-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" by "_copy_volume_from_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] snapshot: e5144927-cd7b-452f-992d-5f22646d789f, volume: 7bd016f1-5304-4d80-bbf4-0b33d1b30faf, {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Created reservations ['38af2596-9011-45ed-bb8a-980489867a09', 'd12353a8-16d5-4cd2-b9aa-04d8ea7bead7', '56ae066c-80b7-4255-a3c0-5f994c3cfeea', '7ae6309e-0aae-4713-a64e-072b9163240f'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca95f2d-9fc5-4680-a402-df229a7d0661]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:31 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:39:31 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:31 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f Jul 23 10:39:31 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:31 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.262s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:39:31 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Deleted volume successfully. Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-8e3828b5-48a6-4b1b-833a-6602024c5684 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-e2c57384-1bff-4072-a258-4ad6b433d45e-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:31 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f" returned: 0 in 0.396s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Creating direct copy from snapshot {{(pid=88371) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7a63ae-92c0-449f-9c57-484de5e067c1]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:31 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb Jul 23 10:39:31 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (851ff4bb-4199-400d-9beb-ccd2dac017a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:31 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ec2c47-d0cd-40e0-a732-c7cfc3835021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ec2c47-d0cd-40e0-a732-c7cfc3835021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-630158901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d2f914-2560-422b-89d8-227f823d3568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:32Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97796dcb-5ca9-483e-8fa7-d97b644a76eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97796dcb-5ca9-483e-8fa7-d97b644a76eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4f2c5c-e523-48de-a8cc-56fa88483bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4f2c5c-e523-48de-a8cc-56fa88483bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d2f914-2560-422b-89d8-227f823d3568', 'volume_name': 'volume-37d2f914-2560-422b-89d8-227f823d3568', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2108841f-0f17-4fd5-a7ef-3eea5e77ea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2108841f-0f17-4fd5-a7ef-3eea5e77ea89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1025cc-b115-464e-9fb8-377e2dce29b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:32 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Volume 37d2f914-2560-422b-89d8-227f823d3568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d2f914-2560-422b-89d8-227f823d3568', 'volume_size': 1} Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:32 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb" returned: 0 in 0.401s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG cinder.utils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Path /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf not found in is_blk_device check {{(pid=88371) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 10:39:32 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:32 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf Jul 23 10:39:32 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:36 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" returned: 0 in 3.928s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38af0b1-1e88-4e88-8bd5-8425a70ac573]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:36 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb Jul 23 10:39:36 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:36 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb" returned: 0 in 0.509s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.image.image_utils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Image conversion details: src /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb, size 1024.00 MB, duration 3.93 sec, destination /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf {{(pid=88371) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 10:39:36 devstack cinder-volume[88371]: INFO cinder.image.image_utils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Converted 1024.00 MB image at 260.63 MB/s Jul 23 10:39:36 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf is being set with open permissions: ugo+rw Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:36 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf Jul 23 10:39:36 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:36 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" returned: 0 in 0.231s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" released by "_copy_volume_from_snapshot" :: held 5.561s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-e5144927-cd7b-452f-992d-5f22646d789f-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" released by "_create_volume_from_snapshot" :: held 5.592s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.610s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.746s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-630158901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d2f914-2560-422b-89d8-227f823d3568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:32Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Creating volume 37d2f914-2560-422b-89d8-227f823d3568 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:39:36 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:36 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 1073741824 Jul 23 10:39:36 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e7cff0-2792-4eee-91af-99b6028eabfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf', 'volume_size': 1, 'snapshot_id': 'e5144927-cd7b-452f-992d-5f22646d789f'}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a6a8fa-a0d1-4085-abe1-86f09d68d458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:36 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Volume volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf (7bd016f1-5304-4d80-bbf4-0b33d1b30faf): created successfully Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a6a8fa-a0d1-4085-abe1-86f09d68d458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:36 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Flow 'volume_create_manager' (8def061a-c88a-4dff-8a74-0709dfd9e867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:36 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-4358b8a4-efa0-4325-8759-a33fa912d3d2 tempest-SnapshotDependencyTests-1910705127 None] Created volume successfully. Jul 23 10:39:37 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 1073741824" returned: 0 in 0.398s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:37 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 Jul 23 10:39:37 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:37 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568" returned: 0 in 0.242s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1025cc-b115-464e-9fb8-377e2dce29b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d2f914-2560-422b-89d8-227f823d3568', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066d524e-8490-4cdf-8002-6931d4060c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:37 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Volume volume-37d2f914-2560-422b-89d8-227f823d3568 (37d2f914-2560-422b-89d8-227f823d3568): created successfully Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066d524e-8490-4cdf-8002-6931d4060c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (851ff4bb-4199-400d-9beb-ccd2dac017a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:37 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-60d84692-22d8-48e9-ad16-181bc5053e1e tempest-ProjectMemberTests-1385482585 None] Created volume successfully. Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "cinder-e5144927-cd7b-452f-992d-5f22646d789f-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-e5144927-cd7b-452f-992d-5f22646d789f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "cinder-quobyte-836d0199-6641-41e5-9aa0-ca2e94dfddfb" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-836d0199-6641-41e5-9aa0-ca2e94dfddfb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "cinder-quobyte-e5144927-cd7b-452f-992d-5f22646d789f" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-e5144927-cd7b-452f-992d-5f22646d789f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Deleting offline snapshot e5144927-cd7b-452f-992d-5f22646d789f of volume 836d0199-6641-41e5-9aa0-ca2e94dfddfb {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] snapshot_file for this snap is: volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6faf1ef-9d81-4a41-ad19-db591e65bde3]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:37 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:37 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f Jul 23 10:39:37 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:38 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f" returned: 0 in 0.348s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb55717-f284-4f0c-8c17-57dd21ede979]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:38 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb Jul 23 10:39:38 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:38 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb" returned: 0 in 0.366s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:38 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f Jul 23 10:39:38 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] Creating offline snapshot ec6b113b-5291-472f-9e2e-9ed1e794699b of volume 37d2f914-2560-422b-89d8-227f823d3568 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[710516d4-1659-43b4-b9e0-ce1065455fb6]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:38 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f" returned: 0 in 0.373s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:38 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:38 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 Jul 23 10:39:38 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:38 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f Jul 23 10:39:38 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:39 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb.e5144927-cd7b-452f-992d-5f22646d789f" returned: 0 in 0.247s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:39 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568" returned: 0 in 0.396s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-e5144927-cd7b-452f-992d-5f22646d789f" released by "_delete_snapshot" :: held 1.442s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-836d0199-6641-41e5-9aa0-ca2e94dfddfb" released by "delete_snapshot" :: held 1.469s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:39 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b 1G Jul 23 10:39:39 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Created reservations ['56699391-4bc8-45b8-8929-3f1857b9bcb3', '6712e254-4eaf-469d-8c72-28ad44d15229', 'a4168ae6-b82a-4f11-a6e6-3723dfe18d14', 'd68b57e8-41c8-4bd3-9a2d-311fb3296b7d'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:39 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Delete snapshot completed successfully. Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-6ed20a09-cd5b-46e8-8be6-8d087a525949 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-e5144927-cd7b-452f-992d-5f22646d789f-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:39 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b 1G" returned: 0 in 0.389s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d2f914-2560-422b-89d8-227f823d3568 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:39 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d2f914-2560-422b-89d8-227f823d3568 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b Jul 23 10:39:39 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "cinder-836d0199-6641-41e5-9aa0-ca2e94dfddfb-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:39 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d2f914-2560-422b-89d8-227f823d3568 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b" returned: 0 in 0.295s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:39 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b is being set with open permissions: ugo+rw Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-836d0199-6641-41e5-9aa0-ca2e94dfddfb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:39 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b Jul 23 10:39:39 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "cinder-quobyte-836d0199-6641-41e5-9aa0-ca2e94dfddfb" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-836d0199-6641-41e5-9aa0-ca2e94dfddfb" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[6216255b-6967-42b6-ab36-e3fe03746606]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:39 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:40 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb Jul 23 10:39:40 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:40 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b" returned: 0 in 0.247s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:40 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.info Jul 23 10:39:40 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:40 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb" returned: 0 in 0.393s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:40 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.info" returned: 0 in 0.257s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:40 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.info is being set with open permissions: ugo+rw Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:40 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb Jul 23 10:39:40 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:40 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.info Jul 23 10:39:40 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:40 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-836d0199-6641-41e5-9aa0-ca2e94dfddfb" returned: 0 in 0.238s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:40 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.info" returned: 0 in 0.237s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-836d0199-6641-41e5-9aa0-ca2e94dfddfb" released by "delete_volume" :: held 0.704s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:40 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ed9d052c-7ac3-4d8f-be34-3a28fe9ae7ec tempest-ProjectMemberTests-1385482585 None] Create snapshot completed successfully Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Created reservations ['0701050c-5ea1-4bdc-9809-b517eeb58388', '63827aab-57f3-4083-bc60-39635b13fce5', '48e9f168-e9af-4831-b7df-e66cd68a006a', '2a0a6e73-f39d-4195-8a6c-e83cea588398'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:40 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:39:40 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-ec6b113b-5291-472f-9e2e-9ed1e794699b-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-ec6b113b-5291-472f-9e2e-9ed1e794699b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-37d2f914-2560-422b-89d8-227f823d3568" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-37d2f914-2560-422b-89d8-227f823d3568" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-ec6b113b-5291-472f-9e2e-9ed1e794699b" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-ec6b113b-5291-472f-9e2e-9ed1e794699b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Deleting offline snapshot ec6b113b-5291-472f-9e2e-9ed1e794699b of volume 37d2f914-2560-422b-89d8-227f823d3568 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] snapshot_file for this snap is: volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33b0363-7a0e-40bc-9281-b1766a237262]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:40 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "cinder-7bd016f1-5304-4d80-bbf4-0b33d1b30faf-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-7bd016f1-5304-4d80-bbf4-0b33d1b30faf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:41 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.284s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:39:41 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Deleted volume successfully. Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-bb1ca2b9-8d16-45e3-b2d3-3836db0d8ee3 tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-836d0199-6641-41e5-9aa0-ca2e94dfddfb-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "cinder-quobyte-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:41 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b Jul 23 10:39:41 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[6743d959-8651-40db-8018-369f812830b7]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:41 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf Jul 23 10:39:41 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:41 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b" returned: 0 in 0.417s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d2f914-2560-422b-89d8-227f823d3568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[43032fa6-06be-4956-bfc2-7bd816cb4504]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:41 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" returned: 0 in 0.371s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:41 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 Jul 23 10:39:41 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:41 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf Jul 23 10:39:41 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:41 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" returned: 0 in 0.238s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:41 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568" returned: 0 in 0.353s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-quobyte-7bd016f1-5304-4d80-bbf4-0b33d1b30faf" released by "delete_volume" :: held 0.661s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:41 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b Jul 23 10:39:41 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Created reservations ['4cf6eb91-5233-49d2-895f-585e4a0fa3ff', '6daccaa7-d6aa-491e-8e9f-2c5f52123106', 'e2401ad9-b84b-4d8d-be35-a93d12ef960f', '1841c2d8-20c1-4f37-a80b-89b432b176f5'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:41 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:41 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:39:41 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:42 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b" returned: 0 in 0.337s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:42 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b Jul 23 10:39:42 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:42 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.273s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:42 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:39:42 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Deleted volume successfully. Jul 23 10:39:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5a1f40ba-efd3-4a6a-bad4-c5621217e77a tempest-SnapshotDependencyTests-1910705127 None] Lock "cinder-7bd016f1-5304-4d80-bbf4-0b33d1b30faf-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:42 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:42 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568.ec6b113b-5291-472f-9e2e-9ed1e794699b" returned: 0 in 0.283s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-ec6b113b-5291-472f-9e2e-9ed1e794699b" released by "_delete_snapshot" :: held 1.497s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-37d2f914-2560-422b-89d8-227f823d3568" released by "delete_snapshot" :: held 1.519s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:42 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Created reservations ['25918db6-8c2d-4a5b-8485-770b1cddbbea', '2632cb35-7764-495a-9ec1-0b3471376624', '3d2435f8-6022-476a-8d15-34c67d404912', '9716e791-b860-47e3-b4ce-4231226759a6'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:42 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Delete snapshot completed successfully. Jul 23 10:39:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-5c8d9779-af51-4e89-8af7-537baedb1447 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-ec6b113b-5291-472f-9e2e-9ed1e794699b-delete_snapshot" released by "delete_snapshot" :: held 1.666s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:42 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-37d2f914-2560-422b-89d8-227f823d3568-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Lock "cinder-37d2f914-2560-422b-89d8-227f823d3568-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-37d2f914-2560-422b-89d8-227f823d3568" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-37d2f914-2560-422b-89d8-227f823d3568" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5778504-11a0-44cc-b120-83af8b955c91]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:43 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 Jul 23 10:39:43 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:43 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568" returned: 0 in 0.407s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:43 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568 Jul 23 10:39:43 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:43 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-37d2f914-2560-422b-89d8-227f823d3568" returned: 0 in 0.272s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-37d2f914-2560-422b-89d8-227f823d3568" released by "delete_volume" :: held 0.740s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Created reservations ['42ef1793-8ff2-4d2d-8adf-ee53004fff48', '5330eb2c-0feb-4f5a-b41e-4176c984933e', 'b5b1d603-80c2-4509-b065-2f57cf3ff874', '455de4e9-0905-4239-b49b-2eb36e244f07'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:43 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:43 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:39:43 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:44 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.246s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:39:44 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Deleted volume successfully. Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-06d3c7b3-66ba-483c-a8a6-fe3d8f29c84c tempest-ProjectMemberTests-1385482585 None] Lock "cinder-37d2f914-2560-422b-89d8-227f823d3568-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (1da8b45b-a4e4-4b68-ac18-9c8982051508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d43c48-4e8d-44d3-87ac-86e7c97504aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d43c48-4e8d-44d3-87ac-86e7c97504aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24726847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7df9241-a393-4533-9caf-fa0d49a8bf33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:45Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27df55b1-76e2-4140-8d40-ec76259c5898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27df55b1-76e2-4140-8d40-ec76259c5898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f7f86b8-046b-4aa9-b1c0-588a944feadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f7f86b8-046b-4aa9-b1c0-588a944feadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7df9241-a393-4533-9caf-fa0d49a8bf33', 'volume_name': 'volume-e7df9241-a393-4533-9caf-fa0d49a8bf33', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0144c456-f148-433a-82ad-67e5d5707613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0144c456-f148-433a-82ad-67e5d5707613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09a48ad-a79c-4d1c-8543-d6f7d9846389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:44 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Volume e7df9241-a393-4533-9caf-fa0d49a8bf33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7df9241-a393-4533-9caf-fa0d49a8bf33', 'volume_size': 1} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24726847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7df9241-a393-4533-9caf-fa0d49a8bf33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:45Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Creating volume e7df9241-a393-4533-9caf-fa0d49a8bf33 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:39:44 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:39:44 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:44 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 1073741824 Jul 23 10:39:44 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:45 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 1073741824" returned: 0 in 0.476s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:45 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 Jul 23 10:39:45 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:45 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33" returned: 0 in 0.252s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:45 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:39:45 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09a48ad-a79c-4d1c-8543-d6f7d9846389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7df9241-a393-4533-9caf-fa0d49a8bf33', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f4051b-7dde-4b9b-be19-b827efba9989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:45 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Volume volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 (e7df9241-a393-4533-9caf-fa0d49a8bf33): created successfully Jul 23 10:39:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f4051b-7dde-4b9b-be19-b827efba9989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:45 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (1da8b45b-a4e4-4b68-ac18-9c8982051508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:45 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6e3e0f90-ed2d-4dc0-9c13-556edf2e360d tempest-ProjectMemberTests-1385482585 None] Created volume successfully. Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:46 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:39:46 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:46 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.269s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG oslo_service.periodic_task [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] Running periodic task VolumeManager._thread_info {{(pid=88371) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread count: 29 {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-253d863f-6b1b-46c4-b8d0-f4261c09fa5c None None] thread info: [<_MainThread(MainThread, started 133042204684416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88371) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] Creating offline snapshot 774f9f65-277f-40f3-b7e9-591c48f54276 of volume e7df9241-a393-4533-9caf-fa0d49a8bf33 {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755efa1-2906-4b36-a258-90a54172b2f3]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:46 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:47 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 Jul 23 10:39:47 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:47 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33" returned: 0 in 0.375s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:47 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 1G Jul 23 10:39:47 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:47 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 1G" returned: 0 in 0.419s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:47 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:47 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 Jul 23 10:39:47 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:48 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276" returned: 0 in 0.318s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:48 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 is being set with open permissions: ugo+rw Jul 23 10:39:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:48 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 Jul 23 10:39:48 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:48 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276" returned: 0 in 0.245s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:48 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.info Jul 23 10:39:48 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:48 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.info" returned: 0 in 0.277s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:48 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.info is being set with open permissions: ugo+rw Jul 23 10:39:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:48 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.info Jul 23 10:39:48 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:48 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.info" returned: 0 in 0.267s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:48 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:48 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b2f35d82-901b-46c9-a1b2-54251c113507 tempest-ProjectMemberTests-1385482585 None] Create snapshot completed successfully Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-774f9f65-277f-40f3-b7e9-591c48f54276-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-774f9f65-277f-40f3-b7e9-591c48f54276-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-e7df9241-a393-4533-9caf-fa0d49a8bf33" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-e7df9241-a393-4533-9caf-fa0d49a8bf33" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-774f9f65-277f-40f3-b7e9-591c48f54276" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-774f9f65-277f-40f3-b7e9-591c48f54276" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Deleting offline snapshot 774f9f65-277f-40f3-b7e9-591c48f54276 of volume e7df9241-a393-4533-9caf-fa0d49a8bf33 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] snapshot_file for this snap is: volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2e8e51-8527-4a4c-a603-b9a8442a07fc]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:50 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 Jul 23 10:39:50 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:50 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276" returned: 0 in 0.383s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7df9241-a393-4533-9caf-fa0d49a8bf33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[9530b90d-3c7d-4392-b940-107e81dc18ee]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:50 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:51 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 Jul 23 10:39:51 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:51 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33" returned: 0 in 0.408s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:51 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 Jul 23 10:39:51 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:51 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276" returned: 0 in 0.340s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:51 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276 Jul 23 10:39:51 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:51 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:51 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33.774f9f65-277f-40f3-b7e9-591c48f54276" returned: 0 in 0.258s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-774f9f65-277f-40f3-b7e9-591c48f54276" released by "_delete_snapshot" :: held 1.507s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:51 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-e7df9241-a393-4533-9caf-fa0d49a8bf33" released by "delete_snapshot" :: held 1.532s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:52 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Created reservations ['4eabb6ee-71d9-4a08-9e05-5c151fe5610f', '79025677-b036-4c68-8d62-af1e7afb500d', '2fb364a3-419b-456c-80b9-e608ea934156', '6c701b22-0adc-4444-92d5-74f11439a3ab'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:53 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Delete snapshot completed successfully. Jul 23 10:39:53 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-0d9f9bae-bc0c-4cce-a8f1-6b41c18ead7b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-774f9f65-277f-40f3-b7e9-591c48f54276-delete_snapshot" released by "delete_snapshot" :: held 3.204s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-e7df9241-a393-4533-9caf-fa0d49a8bf33-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:54 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-e7df9241-a393-4533-9caf-fa0d49a8bf33-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-e7df9241-a393-4533-9caf-fa0d49a8bf33" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:39:55 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-e7df9241-a393-4533-9caf-fa0d49a8bf33" acquired by "delete_volume" :: waited 0.013s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:39:55 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2c57e2-5e8d-4c39-bc2e-188520fe65a8]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:55 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 Jul 23 10:39:55 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:55 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33" returned: 0 in 0.352s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:55 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:55 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33 Jul 23 10:39:55 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:56 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:56 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-e7df9241-a393-4533-9caf-fa0d49a8bf33" returned: 0 in 0.235s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:56 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-e7df9241-a393-4533-9caf-fa0d49a8bf33" released by "delete_volume" :: held 0.641s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:56 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Created reservations ['6db5425f-3e5d-47f7-82df-453b02a41cea', 'c59513af-03bc-4ad4-b355-0000cc5071dd', '91e05355-00d4-478b-a6e2-791ab09c708f', '640c036f-73b1-4dbf-805a-17dc51ed9806'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:39:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:57 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:57 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:39:57 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:57 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:57 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.247s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:57 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:39:57 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Deleted volume successfully. Jul 23 10:39:57 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-212b657b-e578-4992-81d7-fe2c0bbdbb4b tempest-ProjectMemberTests-1385482585 None] Lock "cinder-e7df9241-a393-4533-9caf-fa0d49a8bf33-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (a9a7bd4a-9d1e-4bb9-8a1d-2745ce42773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169e1f6f-6ae4-42c8-8783-17fe03149cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169e1f6f-6ae4-42c8-8783-17fe03149cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823215914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009dd2fc-2945-4833-af31-c1b3100266ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:58Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a56d622-0163-4061-aac4-38665b100697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a56d622-0163-4061-aac4-38665b100697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd4fd1c-e8e5-4c2d-ad0a-02682487d716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd4fd1c-e8e5-4c2d-ad0a-02682487d716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '009dd2fc-2945-4833-af31-c1b3100266ea', 'volume_name': 'volume-009dd2fc-2945-4833-af31-c1b3100266ea', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7395aee-6d10-4200-b519-9bb00efc8832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7395aee-6d10-4200-b519-9bb00efc8832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc5b9f3-89cb-4d12-a12e-868afe79b23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:58 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Volume 009dd2fc-2945-4833-af31-c1b3100266ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-009dd2fc-2945-4833-af31-c1b3100266ea', 'volume_size': 1} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823215914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009dd2fc-2945-4833-af31-c1b3100266ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823d4b6f08a493a9f1b1abe10450304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:39:58Z,use_quota=True,user_id='3934961f6f4140a6bb47397c2d4f98bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Creating volume 009dd2fc-2945-4833-af31-c1b3100266ea {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:39:58 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:58 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea 1073741824 Jul 23 10:39:58 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:58 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea 1073741824" returned: 0 in 0.437s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:58 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:58 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea Jul 23 10:39:58 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:59 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc5b9f3-89cb-4d12-a12e-868afe79b23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-009dd2fc-2945-4833-af31-c1b3100266ea', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c3f51d-4895-4c8c-8bac-385b59fd899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:39:59 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Volume volume-009dd2fc-2945-4833-af31-c1b3100266ea (009dd2fc-2945-4833-af31-c1b3100266ea): created successfully Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c3f51d-4895-4c8c-8bac-385b59fd899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Flow 'volume_create_manager' (a9a7bd4a-9d1e-4bb9-8a1d-2745ce42773c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:39:59 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-8dea7f94-a32d-4bc6-8777-b54fa47d756c tempest-ProjectMemberTests-1385482585 None] Created volume successfully. Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] Creating offline snapshot cc07cbe4-6346-48a3-8b26-32d76b679885 of volume 009dd2fc-2945-4833-af31-c1b3100266ea {{(pid=88371) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f41b50-f420-4e0e-8a5c-2d17900c8c1e]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:59 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea Jul 23 10:39:59 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:39:59 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea" returned: 0 in 0.352s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:39:59 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 1G {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:39:59 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 1G Jul 23 10:39:59 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:00 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 1G" returned: 0 in 0.383s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-009dd2fc-2945-4833-af31-c1b3100266ea -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:00 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-009dd2fc-2945-4833-af31-c1b3100266ea -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 Jul 23 10:40:00 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:00 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-009dd2fc-2945-4833-af31-c1b3100266ea -F qcow2 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885" returned: 0 in 0.318s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:00 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 is being set with open permissions: ugo+rw Jul 23 10:40:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:00 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 Jul 23 10:40:00 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:00 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885" returned: 0 in 0.264s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:00 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:00 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.info Jul 23 10:40:00 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:01 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.info" returned: 0 in 0.255s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:01 devstack cinder-volume[88371]: WARNING cinder.volume.drivers.remotefs [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.info is being set with open permissions: ugo+rw Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.info {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:01 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.info Jul 23 10:40:01 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:01 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.info" returned: 0 in 0.256s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:40:01 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-6b4acc69-c6fd-4fb3-a170-9c465333994b tempest-ProjectMemberTests-1385482585 None] Create snapshot completed successfully Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-cc07cbe4-6346-48a3-8b26-32d76b679885-delete_snapshot" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-cc07cbe4-6346-48a3-8b26-32d76b679885-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-009dd2fc-2945-4833-af31-c1b3100266ea" by "delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-009dd2fc-2945-4833-af31-c1b3100266ea" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-cc07cbe4-6346-48a3-8b26-32d76b679885" by "_delete_snapshot" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-cc07cbe4-6346-48a3-8b26-32d76b679885" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Deleting offline snapshot cc07cbe4-6346-48a3-8b26-32d76b679885 of volume 009dd2fc-2945-4833-af31-c1b3100266ea {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] snapshot_file for this snap is: volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 {{(pid=88371) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb1823b-b867-4335-9bb1-0858c65bf0a9]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:40:01 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:01 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 Jul 23 10:40:01 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:02 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885" returned: 0 in 0.359s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:02 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-009dd2fc-2945-4833-af31-c1b3100266ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88371) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 10:40:02 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a18911-1adb-4b95-a99c-6fdcf63cd464]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:40:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:02 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea Jul 23 10:40:02 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:02 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea" returned: 0 in 0.381s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:02 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 Jul 23 10:40:02 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:02 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885" returned: 0 in 0.353s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:02 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:02 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885 Jul 23 10:40:02 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:03 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea.cc07cbe4-6346-48a3-8b26-32d76b679885" returned: 0 in 0.248s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-cc07cbe4-6346-48a3-8b26-32d76b679885" released by "_delete_snapshot" :: held 1.426s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:40:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-009dd2fc-2945-4833-af31-c1b3100266ea" released by "delete_snapshot" :: held 1.448s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:40:03 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Created reservations ['7e805e8b-116d-41ec-b28c-f55a3bf81864', 'ea67111e-12e8-48b5-85c5-f57a6c9eb248', '6cd1169d-d2c6-4409-8faf-2983d26cb25b', '425132e0-432f-445d-a774-fde5353dad7a'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:40:03 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Delete snapshot completed successfully. Jul 23 10:40:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-aabbc27a-0038-463e-a592-b703208e0508 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-cc07cbe4-6346-48a3-8b26-32d76b679885-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:40:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-009dd2fc-2945-4833-af31-c1b3100266ea-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:40:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-009dd2fc-2945-4833-af31-c1b3100266ea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:40:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "cinder-quobyte-009dd2fc-2945-4833-af31-c1b3100266ea" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:40:03 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-009dd2fc-2945-4833-af31-c1b3100266ea" acquired by "delete_volume" :: waited 0.013s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:40:03 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e15cea-f223-4508-a90c-7b9e97c46289]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:40:03 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:04 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea Jul 23 10:40:04 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:04 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea" returned: 0 in 0.393s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:04 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea Jul 23 10:40:04 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:04 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-009dd2fc-2945-4833-af31-c1b3100266ea" returned: 0 in 0.247s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:04 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-quobyte-009dd2fc-2945-4833-af31-c1b3100266ea" released by "delete_volume" :: held 0.704s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:40:04 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Created reservations ['ebf31a38-dbf8-4662-8fc7-f530599a60c4', 'dd077bf2-9393-43bc-bffc-29bc3651b33d', 'abe3cf73-1df4-4421-8f4e-cbbcddc2d8c4', 'f6efaa1e-b842-4b4d-9838-d7101950a449'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:40:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:40:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:40:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:40:04 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:40:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:40:04 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:04 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:40:04 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:05 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:05 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:05 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:40:05 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Deleted volume successfully. Jul 23 10:40:05 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-ed6e72a1-8473-42c0-a2f9-64e401d4cea7 tempest-ProjectMemberTests-1385482585 None] Lock "cinder-009dd2fc-2945-4833-af31-c1b3100266ea-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Flow 'volume_create_manager' (d80d2c73-219f-4ec8-834b-8c84c93cbee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e9d1f6-d33b-402c-b136-e243996a8460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e9d1f6-d33b-402c-b136-e243996a8460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-468819147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2de653b-e7fb-4927-863f-2cc6b4225120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90409575664dedb3932ae401910f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:40:09Z,use_quota=True,user_id='73fe5eb53fb84d25b64e95d2f46eddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3ee12b-b05f-42e1-bfa5-c2d234b8d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3ee12b-b05f-42e1-bfa5-c2d234b8d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea93f29-4f69-4268-9709-44676181ef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea93f29-4f69-4268-9709-44676181ef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2de653b-e7fb-4927-863f-2cc6b4225120', 'volume_name': 'volume-a2de653b-e7fb-4927-863f-2cc6b4225120', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9925264-68e2-4ab1-beb2-e007f5e9c74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9925264-68e2-4ab1-beb2-e007f5e9c74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0e3cd9-c0e1-4586-9499-8fe4ab2a6004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:08 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Volume a2de653b-e7fb-4927-863f-2cc6b4225120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2de653b-e7fb-4927-863f-2cc6b4225120', 'volume_size': 1} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-468819147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2de653b-e7fb-4927-863f-2cc6b4225120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90409575664dedb3932ae401910f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:40:09Z,use_quota=True,user_id='73fe5eb53fb84d25b64e95d2f46eddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Creating volume a2de653b-e7fb-4927-863f-2cc6b4225120 {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:40:08 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:40:08 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:08 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120 1073741824 Jul 23 10:40:08 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:09 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120 1073741824" returned: 0 in 0.399s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:09 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120 Jul 23 10:40:09 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:09 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120" returned: 0 in 0.253s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0e3cd9-c0e1-4586-9499-8fe4ab2a6004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2de653b-e7fb-4927-863f-2cc6b4225120', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa5efd3-1f9a-4949-8404-8ac4d9e803f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:09 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Volume volume-a2de653b-e7fb-4927-863f-2cc6b4225120 (a2de653b-e7fb-4927-863f-2cc6b4225120): created successfully Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa5efd3-1f9a-4949-8404-8ac4d9e803f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Flow 'volume_create_manager' (d80d2c73-219f-4ec8-834b-8c84c93cbee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:40:09 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-88949bde-b60d-42a8-a505-0a54bb48cfe8 tempest-ProjectReaderTests-885032740 None] Created volume successfully. Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Acquiring lock "cinder-a2de653b-e7fb-4927-863f-2cc6b4225120-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Lock "cinder-a2de653b-e7fb-4927-863f-2cc6b4225120-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Acquiring lock "cinder-quobyte-a2de653b-e7fb-4927-863f-2cc6b4225120" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Lock "cinder-quobyte-a2de653b-e7fb-4927-863f-2cc6b4225120" acquired by "delete_volume" :: waited 0.015s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea44ff04-61c4-4e69-824c-891c244ad770]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:40:09 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:10 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120 Jul 23 10:40:10 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:10 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120" returned: 0 in 0.414s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:10 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120 Jul 23 10:40:10 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:10 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-a2de653b-e7fb-4927-863f-2cc6b4225120" returned: 0 in 0.255s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:10 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Lock "cinder-quobyte-a2de653b-e7fb-4927-863f-2cc6b4225120" released by "delete_volume" :: held 0.711s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:40:10 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Created reservations ['7388bf58-aa09-400b-932e-833d7fb56f88', '5078e3c7-8fd2-40a2-a4c7-ebe9a26c68a0', '1b5057f5-c76a-4d0b-9d2f-740e97bd37dd', '61420645-4dc8-4469-853c-ce0804beb980'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:40:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:40:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:40:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:40:10 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:40:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:40:10 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:10 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:40:10 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:11 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.244s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:40:11 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Deleted volume successfully. Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-b1f4815a-0440-423d-9f31-86512767b371 tempest-ProjectReaderTests-885032740 None] Lock "cinder-a2de653b-e7fb-4927-863f-2cc6b4225120-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88371) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Flow 'volume_create_manager' (d86eb38b-640a-4e26-858d-b6acbe0472a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7020a2-f135-4da2-9ab7-c56d4f4cf869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7020a2-f135-4da2-9ab7-c56d4f4cf869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1114083000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fff6169-284d-4c6d-8bdb-4e20aba6c2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90409575664dedb3932ae401910f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:40:11Z,use_quota=True,user_id='73fe5eb53fb84d25b64e95d2f46eddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70fd83d-4823-4386-8db9-52ecc5616e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70fd83d-4823-4386-8db9-52ecc5616e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee11a57-5b97-459f-8801-4bb8f3dda549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee11a57-5b97-459f-8801-4bb8f3dda549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fff6169-284d-4c6d-8bdb-4e20aba6c2eb', 'volume_name': 'volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b55f58b-025c-4d34-952e-0220f915de0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b55f58b-025c-4d34-952e-0220f915de0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f77076a-8238-4b2b-8cd8-c44febdc7f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:11 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Volume 6fff6169-284d-4c6d-8bdb-4e20aba6c2eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb', 'volume_size': 1} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T08:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1114083000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fff6169-284d-4c6d-8bdb-4e20aba6c2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90409575664dedb3932ae401910f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T08:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T08:40:11Z,use_quota=True,user_id='73fe5eb53fb84d25b64e95d2f46eddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6a1d1d1-3bce-47db-bedf-a86d784acbbc),volume_type_id=e6a1d1d1-3bce-47db-bedf-a86d784acbbc)}" {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.remotefs [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Creating volume 6fff6169-284d-4c6d-8bdb-4e20aba6c2eb {{(pid=88371) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 as target Quobyte volume. {{(pid=88371) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 10:40:11 devstack cinder-volume[88371]: INFO cinder.volume.drivers.remotefs [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377 Jul 23 10:40:11 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb 1073741824 {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:11 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb 1073741824 Jul 23 10:40:11 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:12 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb 1073741824" returned: 0 in 0.446s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:12 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb Jul 23 10:40:12 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:12 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb" returned: 0 in 0.243s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'} {{(pid=88371) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f77076a-8238-4b2b-8cd8-c44febdc7f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb', 'volume_size': 1}' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a6e9aa-de07-4d8d-b8dc-084fff1dc81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 10:40:12 devstack cinder-volume[88371]: INFO cinder.volume.flows.manager.create_volume [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Volume volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb (6fff6169-284d-4c6d-8bdb-4e20aba6c2eb): created successfully Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a6e9aa-de07-4d8d-b8dc-084fff1dc81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88371) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Flow 'volume_create_manager' (d86eb38b-640a-4e26-858d-b6acbe0472a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88371) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 10:40:12 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-b56895ea-7e1d-46e2-a7de-fb0ed7cd329e tempest-ProjectReaderTests-885032740 None] Created volume successfully. Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Acquiring lock "cinder-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb-delete_volume" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Lock "cinder-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Acquiring lock "cinder-quobyte-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb" by "delete_volume" {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Lock "cinder-quobyte-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb" acquired by "delete_volume" :: waited 0.014s {{(pid=88371) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcb697c-ba70-400d-93e1-77bfd3bfa6f5]: (4, 'qcow2') {{(pid=90048) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:12 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb Jul 23 10:40:12 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:12 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb" returned: 0 in 0.356s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:12 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:13 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb Jul 23 10:40:13 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:13 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a/volume-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb" returned: 0 in 0.233s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Lock "cinder-quobyte-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb" released by "delete_volume" :: held 0.624s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG cinder.quota [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Created reservations ['492b2461-9409-4f9c-b569-a515f457d17d', '48efda8e-8ffc-408f-926d-f59c63467350', '01b1020e-f192-48de-b644-8d5a9cf9ca22', '0b98fe1e-9225-44c9-8aa6-a05d5198866c'] {{(pid=88371) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377': None} {{(pid=88371) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG cinder.volume.drivers.quobyte [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a38a60-a0f3-449c-a113-a37b8f939377'] {{(pid=88371) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.lockutils [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88371) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 10:40:13 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a Jul 23 10:40:13 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 10:40:13 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG oslo_concurrency.processutils [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c8d6c458b7d50589967067f710446e3a" returned: 0 in 0.242s {{(pid=88371) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG cinder.manager [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Notifying Schedulers of capabilities ... {{(pid=88371) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 10:40:13 devstack cinder-volume[88371]: INFO cinder.volume.manager [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Deleted volume successfully. Jul 23 10:40:13 devstack cinder-volume[88371]: DEBUG cinder.coordination [None req-23f270a9-4579-4868-b0bd-99a6155ed7b7 tempest-ProjectReaderTests-885032740 None] Lock "cinder-6fff6169-284d-4c6d-8bdb-4e20aba6c2eb-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=88371) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 10:40:23 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=82,cinder:INSERT=38,cinder:UPDATE=114,cinder:DELETE=9 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 10:40:23 devstack cinder-volume[88371]: DEBUG dbcounter [-] [88371] Writing DB stats cinder:SELECT=89,cinder:INSERT=23,cinder:UPDATE=114,cinder:DELETE=9 {{(pid=88371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}